Toward Imagined Speech based Smart Communication System: Potential Applications on Metaverse Conditions

Seo Hyun Lee, Young Eun Lee, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

Metaverse provides an alternative platform for human interaction in the virtual world. Since virtual platform holds few restrictions in changing the surrounding environments or the appearance of the avatars, it can serve as a platform that reflects human thoughts or even dreams at least in the metaverse world. When it is merged together with the current brain-computer interface (BCI) technology, which enables system control via brain signals, a new paradigm of human interaction through mind may be established in the metaverse conditions. Recent BCI systems are aiming to provide user-friendly and intuitive means of communication using brain signals. Imagined speech has become an alternative neuro-paradigm for communicative BCI since it relies directly on a person's speech production process, rather than using speech-unrelated neural activity as the means of communication. In this paper, we propose a brain-to-speech (BTS) system for real-world smart communication using brain signals. Also, we show a demonstration of imagined speech based smart home control through communication with a virtual assistant, which can be one of the future applications of brain-metaverse system. We performed pseudo-online analysis using imagined speech electroencephalography data of nine subjects to investigate the potential use of virtual BTS system in the real-world. Average accuracy of 46.54 ± 9.37 % and 75.56 ± 5.83 % was acquired in the thirteen-class and binary pseudo-online analysis, respectively. Our results support the potential of imagined speech based smart communication to be applied in the metaverse world.

Original languageEnglish
Title of host publication10th International Winter Conference on Brain-Computer Interface, BCI 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665413374
DOIs
Publication statusPublished - 2022
Event10th International Winter Conference on Brain-Computer Interface, BCI 2022 - Gangwon-do, Korea, Republic of
Duration: 2022 Feb 212022 Feb 23

Publication series

NameInternational Winter Conference on Brain-Computer Interface, BCI
Volume2022-February
ISSN (Print)2572-7672

Conference

Conference10th International Winter Conference on Brain-Computer Interface, BCI 2022
Country/TerritoryKorea, Republic of
CityGangwon-do
Period22/2/2122/2/23

Bibliographical note

Publisher Copyright:
© 2022 IEEE.

Keywords

  • Artificial intelligence
  • Brain-computer interface
  • Imagined speech
  • Metaverse
  • Speech synthesis

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Signal Processing

Fingerprint

Dive into the research topics of 'Toward Imagined Speech based Smart Communication System: Potential Applications on Metaverse Conditions'. Together they form a unique fingerprint.

Cite this