The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality

Jiwon Oh; Gerard J. Kim

doi:10.1007/978-3-030-21607-8_11

The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality

Jiwon Oh, Gerard J. Kim

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.

Original language	English
Title of host publication	Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
Editors	Jessie Y.C. Chen, Gino Fragomeni
Publisher	Springer Verlag
Pages	143-152
Number of pages	10
ISBN (Print)	9783030216061
DOIs	https://doi.org/10.1007/978-3-030-21607-8_11
Publication status	Published - 2019
Event	11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States Duration: 2019 Jul 26 → 2019 Jul 31

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11574 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019
Country/Territory	United States
City	Orlando
Period	19/7/26 → 19/7/31

Bibliographical note

Funding Information:
Acknowledgements. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. 2017-0-00179, HD Haptic Technology for Hyper Reality Contents).

Publisher Copyright:
© 2019, Springer Nature Switzerland AG.

Keywords

Onomatopoeia
Sound visualization
User experience
Virtual reality

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-030-21607-8_11

Cite this

Oh, J., & Kim, G. J. (2019). The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality. In J. Y. C. Chen, & G. Fragomeni (Eds.), Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings (pp. 143-152). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11574 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-21607-8_11

The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality. / Oh, Jiwon; Kim, Gerard J.
Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. ed. / Jessie Y.C. Chen; Gino Fragomeni. Springer Verlag, 2019. p. 143-152 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11574 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Oh, J & Kim, GJ 2019, The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality. in JYC Chen & G Fragomeni (eds), Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11574 LNCS, Springer Verlag, pp. 143-152, 11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019, Orlando, United States, 19/7/26. https://doi.org/10.1007/978-3-030-21607-8_11

Oh J, Kim GJ. The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality. In Chen JYC, Fragomeni G, editors, Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. Springer Verlag. 2019. p. 143-152. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-21607-8_11

Oh, Jiwon ; Kim, Gerard J. / The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality. Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. editor / Jessie Y.C. Chen ; Gino Fragomeni. Springer Verlag, 2019. pp. 143-152 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{f6753f99c014425d85b90b0964ebdfd7,

title = "The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality",

abstract = "Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user{\textquoteright}s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.",

keywords = "Onomatopoeia, Sound visualization, User experience, Virtual reality",

author = "Jiwon Oh and Kim, {Gerard J.}",

note = "Funding Information: Acknowledgements. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. 2017-0-00179, HD Haptic Technology for Hyper Reality Contents). Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 ; Conference date: 26-07-2019 Through 31-07-2019",

year = "2019",

doi = "10.1007/978-3-030-21607-8_11",

language = "English",

isbn = "9783030216061",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "143--152",

editor = "Chen, {Jessie Y.C.} and Gino Fragomeni",

booktitle = "Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings",

}

TY - GEN

T1 - The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality

AU - Oh, Jiwon

AU - Kim, Gerard J.

N1 - Funding Information: Acknowledgements. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. 2017-0-00179, HD Haptic Technology for Hyper Reality Contents). Publisher Copyright: © 2019, Springer Nature Switzerland AG.

PY - 2019

Y1 - 2019

N2 - Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.

AB - Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.

KW - Onomatopoeia

KW - Sound visualization

KW - User experience

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85069642902&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-21607-8_11

DO - 10.1007/978-3-030-21607-8_11

M3 - Conference contribution

AN - SCOPUS:85069642902

SN - 9783030216061

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 143

EP - 152

BT - Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings

A2 - Chen, Jessie Y.C.

A2 - Fragomeni, Gino

PB - Springer Verlag

T2 - 11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019

Y2 - 26 July 2019 through 31 July 2019

ER -

The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this