Decoding of human memory formation with EEG signals using convolutional networks

Taeho Kang; Yiyu Chen; Siamac Fazli; Christian Wallraven

doi:10.1109/IWW-BCI.2018.8311487

Decoding of human memory formation with EEG signals using convolutional networks

Taeho Kang, Yiyu Chen, Siamac Fazli, Christian Wallraven

Department of Brain and Cognitive Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.

Original language	English
Title of host publication	2018 6th International Conference on Brain-Computer Interface, BCI 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1-5
Number of pages	5
ISBN (Electronic)	9781538625743
DOIs	https://doi.org/10.1109/IWW-BCI.2018.8311487
Publication status	Published - 2018 Mar 9
Event	6th International Conference on Brain-Computer Interface, BCI 2018 - GangWon, Korea, Republic of Duration: 2018 Jan 15 → 2018 Jan 17

Publication series

Name	2018 6th International Conference on Brain-Computer Interface, BCI 2018
Volume	2018-January

Other

Other	6th International Conference on Brain-Computer Interface, BCI 2018
Country/Territory	Korea, Republic of
City	GangWon
Period	18/1/15 → 18/1/17

Bibliographical note

Funding Information:
ACKNOWLEDGMENT This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451). This publication only reflects the authors views. Funding agencies are not liable for any use that may be made of the information contained herein.

Publisher Copyright:
© 2018 IEEE.

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Behavioral Neuroscience

Access to Document

10.1109/IWW-BCI.2018.8311487

Cite this

Kang, T., Chen, Y., Fazli, S., & Wallraven, C. (2018). Decoding of human memory formation with EEG signals using convolutional networks. In 2018 6th International Conference on Brain-Computer Interface, BCI 2018 (pp. 1-5). (2018 6th International Conference on Brain-Computer Interface, BCI 2018; Vol. 2018-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWW-BCI.2018.8311487

Decoding of human memory formation with EEG signals using convolutional networks. / Kang, Taeho; Chen, Yiyu; Fazli, Siamac et al.
2018 6th International Conference on Brain-Computer Interface, BCI 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-5 (2018 6th International Conference on Brain-Computer Interface, BCI 2018; Vol. 2018-January).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kang, T, Chen, Y, Fazli, S & Wallraven, C 2018, Decoding of human memory formation with EEG signals using convolutional networks. in 2018 6th International Conference on Brain-Computer Interface, BCI 2018. 2018 6th International Conference on Brain-Computer Interface, BCI 2018, vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 1-5, 6th International Conference on Brain-Computer Interface, BCI 2018, GangWon, Korea, Republic of, 18/1/15. https://doi.org/10.1109/IWW-BCI.2018.8311487

Kang T, Chen Y, Fazli S, Wallraven C. Decoding of human memory formation with EEG signals using convolutional networks. In 2018 6th International Conference on Brain-Computer Interface, BCI 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1-5. (2018 6th International Conference on Brain-Computer Interface, BCI 2018). doi: 10.1109/IWW-BCI.2018.8311487

@inproceedings{cd1fe1f192a246faab780f86e122282e,

title = "Decoding of human memory formation with EEG signals using convolutional networks",

abstract = "This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.",

author = "Taeho Kang and Yiyu Chen and Siamac Fazli and Christian Wallraven",

note = "Funding Information: ACKNOWLEDGMENT This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451). This publication only reflects the authors views. Funding agencies are not liable for any use that may be made of the information contained herein. Publisher Copyright: {\textcopyright} 2018 IEEE.; 6th International Conference on Brain-Computer Interface, BCI 2018 ; Conference date: 15-01-2018 Through 17-01-2018",

year = "2018",

month = mar,

day = "9",

doi = "10.1109/IWW-BCI.2018.8311487",

language = "English",

series = "2018 6th International Conference on Brain-Computer Interface, BCI 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1--5",

booktitle = "2018 6th International Conference on Brain-Computer Interface, BCI 2018",

}

TY - GEN

T1 - Decoding of human memory formation with EEG signals using convolutional networks

AU - Kang, Taeho

AU - Chen, Yiyu

AU - Fazli, Siamac

AU - Wallraven, Christian

N1 - Funding Information: ACKNOWLEDGMENT This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451). This publication only reflects the authors views. Funding agencies are not liable for any use that may be made of the information contained herein. Publisher Copyright: © 2018 IEEE.

PY - 2018/3/9

Y1 - 2018/3/9

N2 - This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.

AB - This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.

UR - http://www.scopus.com/inward/record.url?scp=85050809251&partnerID=8YFLogxK

U2 - 10.1109/IWW-BCI.2018.8311487

DO - 10.1109/IWW-BCI.2018.8311487

M3 - Conference contribution

AN - SCOPUS:85050809251

T3 - 2018 6th International Conference on Brain-Computer Interface, BCI 2018

SP - 1

EP - 5

BT - 2018 6th International Conference on Brain-Computer Interface, BCI 2018

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 6th International Conference on Brain-Computer Interface, BCI 2018

Y2 - 15 January 2018 through 17 January 2018

ER -

Decoding of human memory formation with EEG signals using convolutional networks

Abstract

Publication series

Other

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this