Vouch-T: Multimodal text input for mobile devices using voice and touch

Minyoung Lee, Gerard J. Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

Original languageEnglish
Title of host publicationHuman–Computer Interaction
Subtitle of host publicationInteraction Contexts - 19th International Conference, HCI International 2017, Proceedings
EditorsMasaaki Kurosu
PublisherSpringer Verlag
Number of pages17
ISBN (Print)9783319580760
Publication statusPublished - 2017
Event19th International Conference on Human–Computer Interaction, HCI International 2017 - Vancouver, Canada
Duration: 2017 Jul 92017 Jul 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10272 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other19th International Conference on Human–Computer Interaction, HCI International 2017

Bibliographical note

Publisher Copyright:
© Springer International Publishing AG 2017.


  • Keyboard
  • Multimodal input
  • Smart phone
  • Smart watch
  • Task performance
  • Text input
  • Usability
  • Voice

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Vouch-T: Multimodal text input for mobile devices using voice and touch'. Together they form a unique fingerprint.

Cite this