Towards an EEG-based intuitive BCI communication system using imagined speech and visual imagery

Seo Hyun Lee, Minji Lee, Ji Hoon Jeong, Seong Whan Lee

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    88 Citations (Scopus)

    Abstract

    Communication using brain-computer interface (BCI) has developed in attempts toward an intuitive system by decoding the imagined speech or visual imagery. However, discrimination between the two paradigms may be ambiguous because the user intention contains their original meaning. A clear distinction between the two paradigms may facilitate the active use of them leading to an intuitive BCI conversation system. In this study, we compared imagined speech and visual imagery in the perspective of its presence, spatial features, and classification performance based on electroencephalography. Seven subjects performed both imagined speech and visual imagery of twelve words/phrases. We showed the presence of the two paradigms, having distinct brain region from each other. The maximum thirteen-class classification accuracy including rest class was 34.2 % for imagined speech and 26.7 % for visual imagery. Therefore, we investigated the possibility of multiclass classification of more than ten classes in both paradigms, showing the potential of them to be used in the real world communication system. These findings could further be utilized in the intuitive communication for locked-in patients sending commands to the external world simply by thinking of 'the very thing' that the user wants to deliver.

    Original languageEnglish
    Title of host publication2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages4409-4414
    Number of pages6
    ISBN (Electronic)9781728145693
    DOIs
    Publication statusPublished - 2019 Oct
    Event2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019 - Bari, Italy
    Duration: 2019 Oct 62019 Oct 9

    Publication series

    NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
    Volume2019-October
    ISSN (Print)1062-922X

    Conference

    Conference2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
    Country/TerritoryItaly
    CityBari
    Period19/10/619/10/9

    Bibliographical note

    Funding Information:
    * Research supported by the Institute for Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (No. 2017-0-00451; Development of BCI based Brain and Cognitive Computing Technology for Recognizing User’s Intentions using Deep Learning).

    Publisher Copyright:
    © 2019 IEEE.

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering
    • Control and Systems Engineering
    • Human-Computer Interaction

    Fingerprint

    Dive into the research topics of 'Towards an EEG-based intuitive BCI communication system using imagined speech and visual imagery'. Together they form a unique fingerprint.

    Cite this