Vouch-T: Multimodal text input for mobile devices using voice and touch

Minyoung Lee, Gerard J. Kim

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

    Original languageEnglish
    Title of host publicationHuman–Computer Interaction
    Subtitle of host publicationInteraction Contexts - 19th International Conference, HCI International 2017, Proceedings
    EditorsMasaaki Kurosu
    PublisherSpringer Verlag
    Pages208-224
    Number of pages17
    ISBN (Print)9783319580760
    DOIs
    Publication statusPublished - 2017
    Event19th International Conference on Human–Computer Interaction, HCI International 2017 - Vancouver, Canada
    Duration: 2017 Jul 92017 Jul 14

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume10272 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Other

    Other19th International Conference on Human–Computer Interaction, HCI International 2017
    Country/TerritoryCanada
    CityVancouver
    Period17/7/917/7/14

    Bibliographical note

    Publisher Copyright:
    © Springer International Publishing AG 2017.

    Keywords

    • Keyboard
    • Multimodal input
    • Smart phone
    • Smart watch
    • Task performance
    • Text input
    • Usability
    • Voice

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • General Computer Science

    Fingerprint

    Dive into the research topics of 'Vouch-T: Multimodal text input for mobile devices using voice and touch'. Together they form a unique fingerprint.

    Cite this