Towards an EEG-based intuitive BCI communication system using imagined speech and visual imagery

Seo Hyun Lee, Minji Lee, Ji Hoon Jeong, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

66 Citations (Scopus)

Abstract

Communication using brain-computer interface (BCI) has developed in attempts toward an intuitive system by decoding the imagined speech or visual imagery. However, discrimination between the two paradigms may be ambiguous because the user intention contains their original meaning. A clear distinction between the two paradigms may facilitate the active use of them leading to an intuitive BCI conversation system. In this study, we compared imagined speech and visual imagery in the perspective of its presence, spatial features, and classification performance based on electroencephalography. Seven subjects performed both imagined speech and visual imagery of twelve words/phrases. We showed the presence of the two paradigms, having distinct brain region from each other. The maximum thirteen-class classification accuracy including rest class was 34.2 % for imagined speech and 26.7 % for visual imagery. Therefore, we investigated the possibility of multiclass classification of more than ten classes in both paradigms, showing the potential of them to be used in the real world communication system. These findings could further be utilized in the intuitive communication for locked-in patients sending commands to the external world simply by thinking of 'the very thing' that the user wants to deliver.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4409-4414
Number of pages6
ISBN (Electronic)9781728145693
DOIs
Publication statusPublished - 2019 Oct
Event2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019 - Bari, Italy
Duration: 2019 Oct 62019 Oct 9

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
Volume2019-October
ISSN (Print)1062-922X

Conference

Conference2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
Country/TerritoryItaly
CityBari
Period19/10/619/10/9

Bibliographical note

Funding Information:
* Research supported by the Institute for Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (No. 2017-0-00451; Development of BCI based Brain and Cognitive Computing Technology for Recognizing User’s Intentions using Deep Learning).

Publisher Copyright:
© 2019 IEEE.

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Towards an EEG-based intuitive BCI communication system using imagined speech and visual imagery'. Together they form a unique fingerprint.

Cite this