Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation

Taeho Kang; Yiyu Chen; Siamac Fazli; Christian Wallraven

doi:10.1007/978-3-319-91593-7_7

Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation

Taeho Kang, Yiyu Chen, Siamac Fazli, Christian Wallraven

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.

Original language	English
Title of host publication	Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers
Editors	Benjamin Blankertz, Anna Spagnolli, Luciano Gamberini, Giulio Jacucci, Jaap Ham
Publisher	Springer Verlag
Pages	63-73
Number of pages	11
ISBN (Print)	9783319915920
DOIs	https://doi.org/10.1007/978-3-319-91593-7_7
Publication status	Published - 2018
Event	6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017 - Eindhoven, Netherlands Duration: 2017 Dec 18 → 2017 Dec 19

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10727 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017
Country/Territory	Netherlands
City	Eindhoven
Period	17/12/18 → 17/12/19

Bibliographical note

Funding Information:
Acknowledgment. This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451). This publication only reflects the authors views.

Publisher Copyright:
© Springer International Publishing AG, part of Springer Nature 2018.

Keywords

BCI
EEG
Education
Language learning
Memory

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-319-91593-7_7

Cite this

Kang, T., Chen, Y., Fazli, S., & Wallraven, C. (2018). Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. In B. Blankertz, A. Spagnolli, L. Gamberini, G. Jacucci, & J. Ham (Eds.), Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers (pp. 63-73). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10727 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-91593-7_7

Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. / Kang, Taeho; Chen, Yiyu; Fazli, Siamac et al.
Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. ed. / Benjamin Blankertz; Anna Spagnolli; Luciano Gamberini; Giulio Jacucci; Jaap Ham. Springer Verlag, 2018. p. 63-73 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10727 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kang, T, Chen, Y, Fazli, S & Wallraven, C 2018, Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. in B Blankertz, A Spagnolli, L Gamberini, G Jacucci & J Ham (eds), Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10727 LNCS, Springer Verlag, pp. 63-73, 6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017, Eindhoven, Netherlands, 17/12/18. https://doi.org/10.1007/978-3-319-91593-7_7

Kang T, Chen Y, Fazli S, Wallraven C. Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. In Blankertz B, Spagnolli A, Gamberini L, Jacucci G, Ham J, editors, Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. Springer Verlag. 2018. p. 63-73. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-91593-7_7

Kang, Taeho ; Chen, Yiyu ; Fazli, Siamac et al. / Predicting what you remember from brain activity : EEG-based decoding of long-term memory formation. Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. editor / Benjamin Blankertz ; Anna Spagnolli ; Luciano Gamberini ; Giulio Jacucci ; Jaap Ham. Springer Verlag, 2018. pp. 63-73 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{4a1a31a17191406b95e4ffd020282b42,

title = "Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation",

abstract = "The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.",

keywords = "BCI, EEG, Education, Language learning, Memory",

author = "Taeho Kang and Yiyu Chen and Siamac Fazli and Christian Wallraven",

note = "Funding Information: Acknowledgment. This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451). This publication only reflects the authors views. Publisher Copyright: {\textcopyright} Springer International Publishing AG, part of Springer Nature 2018.; 6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017 ; Conference date: 18-12-2017 Through 19-12-2017",

year = "2018",

doi = "10.1007/978-3-319-91593-7_7",

language = "English",

isbn = "9783319915920",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "63--73",

editor = "Benjamin Blankertz and Anna Spagnolli and Luciano Gamberini and Giulio Jacucci and Jaap Ham",

booktitle = "Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers",

}

TY - GEN

T1 - Predicting what you remember from brain activity

T2 - 6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017

AU - Kang, Taeho

AU - Chen, Yiyu

AU - Fazli, Siamac

AU - Wallraven, Christian

N1 - Funding Information: Acknowledgment. This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451). This publication only reflects the authors views. Publisher Copyright: © Springer International Publishing AG, part of Springer Nature 2018.

PY - 2018

Y1 - 2018

N2 - The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.

AB - The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.

KW - BCI

KW - EEG

KW - Education

KW - Language learning

KW - Memory

UR - http://www.scopus.com/inward/record.url?scp=85051675154&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-91593-7_7

DO - 10.1007/978-3-319-91593-7_7

M3 - Conference contribution

AN - SCOPUS:85051675154

SN - 9783319915920

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 63

EP - 73

BT - Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers

A2 - Blankertz, Benjamin

A2 - Spagnolli, Anna

A2 - Gamberini, Luciano

A2 - Jacucci, Giulio

A2 - Ham, Jaap

PB - Springer Verlag

Y2 - 18 December 2017 through 19 December 2017

ER -

Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation

Abstract

Publication series

Other

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this