Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information

Sofie Therese Hansen; Irene Winkler; Lars Kai Hansen; Klaus Robert Muller; Sven Dahne

doi:10.1109/PRNI.2015.22

Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information

Sofie Therese Hansen, Irene Winkler, Lars Kai Hansen, Klaus Robert Muller, Sven Dahne

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Simultaneously measuring electro physical and hemodynamic signals has become more accessible in the last years and the need for modeling techniques that can fuse the modalities is growing. In this work we augment a specific fusion method, the multimodal Source Power Co-modulation (mSPoC), to not only use functional but also anatomical information. The goal is to extract correlated source components from electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Anatomical information enters our proposed extension to mSPoC via the forward model, which relates the activity on cortex level to the EEG sensors. The augmented mSPoC is shown to outperform the original version in realistic simulations where the signal to noise ratio is low or where training epochs are scarce.

Original language	English
Title of host publication	Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	33-36
Number of pages	4
ISBN (Electronic)	9781467371452
DOIs	https://doi.org/10.1109/PRNI.2015.22
Publication status	Published - 2015 Sept 16
Event	5th International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015 - Stanford, United States Duration: 2015 Jun 10 → 2015 Jun 12

Publication series

Name	Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015

Other

Other	5th International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015
Country/Territory	United States
City	Stanford
Period	15/6/10 → 15/6/12

Bibliographical note

Funding Information:
LKH acknowledges support from the Danish Lundbeck Foundation via the Center for Integrated Molecular Brain Imaging (CIMBI). SD acknowledges funding by the German Research Foundation (DFG) grant no. MU 987/19-1 and support by the Bernstein Center for Computational Neuroscience, Berlin through the graduate program GRK 1589/1. KRM acknowledges support by the Brain Korea 21 Plus Program through the National Research Foundation of Korea funded by the Ministry of Education.

Publisher Copyright:
© 2015 IEEE.

Keywords

EEG
Fusion
Multimodal neuroimaging
Oscillation
fMRI

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Radiology Nuclear Medicine and imaging

Access to Document

10.1109/PRNI.2015.22

Cite this

Hansen, S. T., Winkler, I., Hansen, L. K., Muller, K. R., & Dahne, S. (2015). Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information. In Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015 (pp. 33-36). Article 7270841 (Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PRNI.2015.22

Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information. / Hansen, Sofie Therese; Winkler, Irene; Hansen, Lars Kai et al.
Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 33-36 7270841 (Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hansen, ST, Winkler, I, Hansen, LK, Muller, KR & Dahne, S 2015, Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information. in Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015., 7270841, Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015, Institute of Electrical and Electronics Engineers Inc., pp. 33-36, 5th International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015, Stanford, United States, 15/6/10. https://doi.org/10.1109/PRNI.2015.22

Hansen ST, Winkler I, Hansen LK, Muller KR, Dahne S. Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information. In Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 33-36. 7270841. (Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015). doi: 10.1109/PRNI.2015.22

Hansen, Sofie Therese ; Winkler, Irene ; Hansen, Lars Kai et al. / Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information. Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 33-36 (Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015).

@inproceedings{a308fa3626734259adb85b5c0d1ea657,

title = "Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information",

abstract = "Simultaneously measuring electro physical and hemodynamic signals has become more accessible in the last years and the need for modeling techniques that can fuse the modalities is growing. In this work we augment a specific fusion method, the multimodal Source Power Co-modulation (mSPoC), to not only use functional but also anatomical information. The goal is to extract correlated source components from electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Anatomical information enters our proposed extension to mSPoC via the forward model, which relates the activity on cortex level to the EEG sensors. The augmented mSPoC is shown to outperform the original version in realistic simulations where the signal to noise ratio is low or where training epochs are scarce.",

keywords = "EEG, Fusion, Multimodal neuroimaging, Oscillation, fMRI",

author = "Hansen, {Sofie Therese} and Irene Winkler and Hansen, {Lars Kai} and Muller, {Klaus Robert} and Sven Dahne",

note = "Funding Information: LKH acknowledges support from the Danish Lundbeck Foundation via the Center for Integrated Molecular Brain Imaging (CIMBI). SD acknowledges funding by the German Research Foundation (DFG) grant no. MU 987/19-1 and support by the Bernstein Center for Computational Neuroscience, Berlin through the graduate program GRK 1589/1. KRM acknowledges support by the Brain Korea 21 Plus Program through the National Research Foundation of Korea funded by the Ministry of Education. Publisher Copyright: {\textcopyright} 2015 IEEE.; 5th International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015 ; Conference date: 10-06-2015 Through 12-06-2015",

year = "2015",

month = sep,

day = "16",

doi = "10.1109/PRNI.2015.22",

language = "English",

series = "Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "33--36",

booktitle = "Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015",

}

TY - GEN

T1 - Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information

AU - Hansen, Sofie Therese

AU - Winkler, Irene

AU - Hansen, Lars Kai

AU - Muller, Klaus Robert

AU - Dahne, Sven

N1 - Funding Information: LKH acknowledges support from the Danish Lundbeck Foundation via the Center for Integrated Molecular Brain Imaging (CIMBI). SD acknowledges funding by the German Research Foundation (DFG) grant no. MU 987/19-1 and support by the Bernstein Center for Computational Neuroscience, Berlin through the graduate program GRK 1589/1. KRM acknowledges support by the Brain Korea 21 Plus Program through the National Research Foundation of Korea funded by the Ministry of Education. Publisher Copyright: © 2015 IEEE.

PY - 2015/9/16

Y1 - 2015/9/16

N2 - Simultaneously measuring electro physical and hemodynamic signals has become more accessible in the last years and the need for modeling techniques that can fuse the modalities is growing. In this work we augment a specific fusion method, the multimodal Source Power Co-modulation (mSPoC), to not only use functional but also anatomical information. The goal is to extract correlated source components from electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Anatomical information enters our proposed extension to mSPoC via the forward model, which relates the activity on cortex level to the EEG sensors. The augmented mSPoC is shown to outperform the original version in realistic simulations where the signal to noise ratio is low or where training epochs are scarce.

AB - Simultaneously measuring electro physical and hemodynamic signals has become more accessible in the last years and the need for modeling techniques that can fuse the modalities is growing. In this work we augment a specific fusion method, the multimodal Source Power Co-modulation (mSPoC), to not only use functional but also anatomical information. The goal is to extract correlated source components from electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Anatomical information enters our proposed extension to mSPoC via the forward model, which relates the activity on cortex level to the EEG sensors. The augmented mSPoC is shown to outperform the original version in realistic simulations where the signal to noise ratio is low or where training epochs are scarce.

KW - EEG

KW - Fusion

KW - Multimodal neuroimaging

KW - Oscillation

KW - fMRI

UR - http://www.scopus.com/inward/record.url?scp=84961845504&partnerID=8YFLogxK

U2 - 10.1109/PRNI.2015.22

DO - 10.1109/PRNI.2015.22

M3 - Conference contribution

AN - SCOPUS:84961845504

T3 - Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015

SP - 33

EP - 36

BT - Proceedings - 2015 International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 5th International Workshop on Pattern Recognition in NeuroImaging, PRNI 2015

Y2 - 10 June 2015 through 12 June 2015

ER -

Fusing Simultaneous EEG and fMRI Using Functional and Anatomical Information

Abstract

Publication series

Other

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this