TY - GEN
T1 - Recurrent convolutional neural network model based on temporal and spatial feature for motor imagery classification
AU - Lee, Seung Bo
AU - Kim, Hakseung
AU - Jeong, Ji Hoon
AU - Wang, In Nea
AU - Lee, Seong Whan
AU - Kim, Dong Joo
N1 - Funding Information:
This work was supported by Institute for Information & communications Technology Promotion(IITP) grant funded by the Korea government(MSIT) (No. 2017-0-00432, Development of non-invasive integrated BCI SW platform to control home appliances and external devices by user's thought via AR/VR interface).
Publisher Copyright:
© 2019 IEEE.
PY - 2019/2
Y1 - 2019/2
N2 - Brain computer interface (BCI) could be useful in improving the quality of life for paralyzed patients. Motor imagery classification has recently been a center of research interest in the BCI-based rehabilitation. As of current, spatial features and spectral features were often used independently for motor imagery classification. While few studies attempted to combine the information from varying domains including spectral, spatial and temporal feature, the attempts employed simplistic linear models. In this study, a novel feature extraction method for including spatial and temporal information is proposed. The method uses recurrent convolutional neural network (RCNN) which excels in temporal and spatial classification. The method was tested for classifying wrist twisting-related task classification during manipulation of robotic arm via electroencephalography, and the performance of the method was compared to the conventional motor imagery classifiers with common spatial pattern (CSP) filter. The proposed method showed 73.9% accuracy in the classification of three types of tasks, whereas the highest accuracy achieved by conventional models was 59.5%. Overall, the performance of the proposed RCNN model was greater than the conventional models using the CSP as input features. The findings warrant further application of the proposed methods in varying BCI environment.
AB - Brain computer interface (BCI) could be useful in improving the quality of life for paralyzed patients. Motor imagery classification has recently been a center of research interest in the BCI-based rehabilitation. As of current, spatial features and spectral features were often used independently for motor imagery classification. While few studies attempted to combine the information from varying domains including spectral, spatial and temporal feature, the attempts employed simplistic linear models. In this study, a novel feature extraction method for including spatial and temporal information is proposed. The method uses recurrent convolutional neural network (RCNN) which excels in temporal and spatial classification. The method was tested for classifying wrist twisting-related task classification during manipulation of robotic arm via electroencephalography, and the performance of the method was compared to the conventional motor imagery classifiers with common spatial pattern (CSP) filter. The proposed method showed 73.9% accuracy in the classification of three types of tasks, whereas the highest accuracy achieved by conventional models was 59.5%. Overall, the performance of the proposed RCNN model was greater than the conventional models using the CSP as input features. The findings warrant further application of the proposed methods in varying BCI environment.
KW - deep learning
KW - motor imagery
KW - recurrent convolutional neural network
KW - robot arm
UR - http://www.scopus.com/inward/record.url?scp=85068347901&partnerID=8YFLogxK
U2 - 10.1109/IWW-BCI.2019.8737350
DO - 10.1109/IWW-BCI.2019.8737350
M3 - Conference contribution
AN - SCOPUS:85068347901
T3 - 7th International Winter Conference on Brain-Computer Interface, BCI 2019
BT - 7th International Winter Conference on Brain-Computer Interface, BCI 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 7th International Winter Conference on Brain-Computer Interface, BCI 2019
Y2 - 18 February 2019 through 20 February 2019
ER -