MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications

Myunghee Lee, Gerard J. Kim, Jeonghyun Baek

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

Original languageEnglish
Title of host publicationDistributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings
EditorsNorbert Streitz, Panos Markopoulos
PublisherSpringer Verlag
Pages172-179
Number of pages8
ISBN (Print)9783319586960
DOIs
Publication statusPublished - 2017
Event5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017 - Vancouver, Canada
Duration: 2017 Jul 92017 Jul 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10291 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017
Country/TerritoryCanada
CityVancouver
Period17/7/917/7/14

Keywords

  • Cloud based interaction
  • Multimodal interaction
  • Software framework
  • Ubiquitous interaction

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications'. Together they form a unique fingerprint.

Cite this