A hierarchical classification strategy for robust detection of passive/active mental state using user-voluntary pitch imagery task

Young Jin Kee, Min Ho Lee, John Williamson, Seong Whan Lee

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    Event-related potentials (ERPs) represent neuronal activity in the brain elicited by external visual/auditory stimulation, and it is widely used in brain-computer interface (BCI) systems. The ERP responses are elicited a few milliseconds after attending to an oddball stimulus; target and non-Target stimulus are repeatedly flashed while the electroencephalography (EEG) is recording. ERP responses in the EEG signal have a poor signal-To-ratio in single-Trial analysis; therefore, the epochs of the target and non-Target trials are averaged over time in order to improve their decoding accuracy. Furthermore, these exogenous potentials can be naturally evoked by just looking at a target symbol. Therefore, the BCI system could generate unintended commands without considering the user's intention. In this study, we approach this dilemma by assuming that a greater effort for the mental task would evoke a stronger positive/negative ERP deflection. Three mental states are defined: passive gazing, active counting, and pitch-imagery. The experiments results showed significantly enhanced ERP patterns and averaged decoding accuracies of 80%, 95.4%, and 95.6%, respectively. The decoding accuracies between both active tasks and the passive task showed an averaged accuracy of 57.5% (gazing vs. counting) and 72.5% (gazing vs. pitch-imagery). Following this result, we proposed a hierarchy classification strategy where the passive or active mental state is decoded in the first stage, and the target stimuli are estimated in the second stage. Our work is the first to propose a system that classifies an intended or unintended brain state by considering the measurable differences of mental effort in the EEG signal so that unintended commands to the system are minimized.

    Original languageEnglish
    Title of host publicationProceedings - 4th Asian Conference on Pattern Recognition, ACPR 2017
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages876-881
    Number of pages6
    ISBN (Electronic)9781538633540
    DOIs
    Publication statusPublished - 2018 Dec 13
    Event4th Asian Conference on Pattern Recognition, ACPR 2017 - Nanjing, China
    Duration: 2017 Nov 262017 Nov 29

    Publication series

    NameProceedings - 4th Asian Conference on Pattern Recognition, ACPR 2017

    Other

    Other4th Asian Conference on Pattern Recognition, ACPR 2017
    Country/TerritoryChina
    CityNanjing
    Period17/11/2617/11/29

    Bibliographical note

    Funding Information:
    This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the SW Starlab support program(IITP-2015-1107) supervised by the IITP(Institute for Information & Communications Technology Promotion).

    Publisher Copyright:
    © 2017 IEEE.

    Keywords

    • Brain-computer interface
    • Electroencephalography
    • Event-related potential
    • Pitch-imagery task

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Vision and Pattern Recognition
    • Signal Processing

    Fingerprint

    Dive into the research topics of 'A hierarchical classification strategy for robust detection of passive/active mental state using user-voluntary pitch imagery task'. Together they form a unique fingerprint.

    Cite this