The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality

Jiwon Oh, Gerard J. Kim

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    3 Citations (Scopus)

    Abstract

    Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.

    Original languageEnglish
    Title of host publicationVirtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
    EditorsJessie Y.C. Chen, Gino Fragomeni
    PublisherSpringer Verlag
    Pages143-152
    Number of pages10
    ISBN (Print)9783030216061
    DOIs
    Publication statusPublished - 2019
    Event11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States
    Duration: 2019 Jul 262019 Jul 31

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume11574 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019
    Country/TerritoryUnited States
    CityOrlando
    Period19/7/2619/7/31

    Bibliographical note

    Funding Information:
    Acknowledgements. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. 2017-0-00179, HD Haptic Technology for Hyper Reality Contents).

    Publisher Copyright:
    © 2019, Springer Nature Switzerland AG.

    Keywords

    • Onomatopoeia
    • Sound visualization
    • User experience
    • Virtual reality

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • General Computer Science

    Fingerprint

    Dive into the research topics of 'The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality'. Together they form a unique fingerprint.

    Cite this