Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation

Bogyeong Kang; Hyeonyeong Nam; Ji Wung Han; Keun Soo Heo; Tae Eui Kam

doi:10.1007/978-3-031-44153-0_10

Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation

Bogyeong Kang
, Hyeonyeong Nam
, Ji Wung Han
, Keun Soo Heo
, Tae Eui Kam^*

^*Corresponding author for this work

Department of Artificial Intelligence

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this work, we propose a multi-view image translation framework, which can translate contrast-enhanced T₁ (ceT₁) MR imaging to high-resolution T₂ (hrT₂) MR imaging for unsupervised vestibular schwannoma and cochlea segmentation. We adopt two image translation models in parallel that use a pixel-level consistent constraint and a patch-level contrastive constraint, respectively. Thereby, we can augment pseudo-hrT₂ images reflecting different perspectives, which eventually lead to a high-performing segmentation model. Our experimental results on the CrossMoDA challenge show that the proposed method achieved enhanced performance on the vestibular schwannoma and cochlea segmentation.

Original language	English
Title of host publication	Brainlesion
Subtitle of host publication	Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 8th International Workshop, BrainLes 2022, Held in Conjunction with MICCAI 2022, Revised Selected Papers
Editors	Spyridon Bakas, Ujjwal Baid, Bhakti Baheti, Alessandro Crimi, Sylwia Malec, Monika Pytlarz, Maximilian Zenk, Reuben Dorent
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	100-108
Number of pages	9
ISBN (Print)	9783031441523
DOIs	https://doi.org/10.1007/978-3-031-44153-0_10
Publication status	Published - 2023
Event	8th International MICCAI Brainlesion Workshop, BrainLes 2022 - Singapore, Singapore Duration: 2022 Sept 18 → 2022 Sept 18

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14092 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	8th International MICCAI Brainlesion Workshop, BrainLes 2022
Country/Territory	Singapore
City	Singapore
Period	22/9/18 → 22/9/18

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

Keywords

Cross-modality
MRI segmentation
Multi-view image translation
Unsupervised domain adaptation

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-031-44153-0_10

Cite this

Kang, B., Nam, H., Han, J. W., Heo, K. S., & Kam, T. E. (2023). Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation. In S. Bakas, U. Baid, B. Baheti, A. Crimi, S. Malec, M. Pytlarz, M. Zenk, & R. Dorent (Eds.), Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 8th International Workshop, BrainLes 2022, Held in Conjunction with MICCAI 2022, Revised Selected Papers (pp. 100-108). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14092 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-44153-0_10

Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation. / Kang, Bogyeong; Nam, Hyeonyeong; Han, Ji Wung et al.
Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 8th International Workshop, BrainLes 2022, Held in Conjunction with MICCAI 2022, Revised Selected Papers. ed. / Spyridon Bakas; Ujjwal Baid; Bhakti Baheti; Alessandro Crimi; Sylwia Malec; Monika Pytlarz; Maximilian Zenk; Reuben Dorent. Springer Science and Business Media Deutschland GmbH, 2023. p. 100-108 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14092 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kang, B, Nam, H, Han, JW, Heo, KS & Kam, TE 2023, Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation. in S Bakas, U Baid, B Baheti, A Crimi, S Malec, M Pytlarz, M Zenk & R Dorent (eds), Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 8th International Workshop, BrainLes 2022, Held in Conjunction with MICCAI 2022, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14092 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 100-108, 8th International MICCAI Brainlesion Workshop, BrainLes 2022, Singapore, Singapore, 22/9/18. https://doi.org/10.1007/978-3-031-44153-0_10

Kang B, Nam H, Han JW, Heo KS, Kam TE. Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation. In Bakas S, Baid U, Baheti B, Crimi A, Malec S, Pytlarz M, Zenk M, Dorent R, editors, Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 8th International Workshop, BrainLes 2022, Held in Conjunction with MICCAI 2022, Revised Selected Papers. Springer Science and Business Media Deutschland GmbH. 2023. p. 100-108. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-44153-0_10

Kang, Bogyeong ; Nam, Hyeonyeong ; Han, Ji Wung et al. / Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation. Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 8th International Workshop, BrainLes 2022, Held in Conjunction with MICCAI 2022, Revised Selected Papers. editor / Spyridon Bakas ; Ujjwal Baid ; Bhakti Baheti ; Alessandro Crimi ; Sylwia Malec ; Monika Pytlarz ; Maximilian Zenk ; Reuben Dorent. Springer Science and Business Media Deutschland GmbH, 2023. pp. 100-108 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{e6ade7ac5d954e61956a1cffa4f79854,

title = "Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation",

abstract = "In this work, we propose a multi-view image translation framework, which can translate contrast-enhanced T1 (ceT1) MR imaging to high-resolution T2 (hrT2) MR imaging for unsupervised vestibular schwannoma and cochlea segmentation. We adopt two image translation models in parallel that use a pixel-level consistent constraint and a patch-level contrastive constraint, respectively. Thereby, we can augment pseudo-hrT2 images reflecting different perspectives, which eventually lead to a high-performing segmentation model. Our experimental results on the CrossMoDA challenge show that the proposed method achieved enhanced performance on the vestibular schwannoma and cochlea segmentation.",

keywords = "Cross-modality, MRI segmentation, Multi-view image translation, Unsupervised domain adaptation",

author = "Bogyeong Kang and Hyeonyeong Nam and Han, \{Ji Wung\} and Heo, \{Keun Soo\} and Kam, \{Tae Eui\}",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.; 8th International MICCAI Brainlesion Workshop, BrainLes 2022 ; Conference date: 18-09-2022 Through 18-09-2022",

year = "2023",

doi = "10.1007/978-3-031-44153-0\_10",

language = "English",

isbn = "9783031441523",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "100--108",

editor = "Spyridon Bakas and Ujjwal Baid and Bhakti Baheti and Alessandro Crimi and Sylwia Malec and Monika Pytlarz and Maximilian Zenk and Reuben Dorent",

booktitle = "Brainlesion",

address = "Germany",

}

TY - GEN

T1 - Multi-view Cross-Modality MR Image Translation for Vestibular Schwannoma and Cochlea Segmentation

AU - Kang, Bogyeong

AU - Nam, Hyeonyeong

AU - Han, Ji Wung

AU - Heo, Keun Soo

AU - Kam, Tae Eui

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

PY - 2023

Y1 - 2023

N2 - In this work, we propose a multi-view image translation framework, which can translate contrast-enhanced T1 (ceT1) MR imaging to high-resolution T2 (hrT2) MR imaging for unsupervised vestibular schwannoma and cochlea segmentation. We adopt two image translation models in parallel that use a pixel-level consistent constraint and a patch-level contrastive constraint, respectively. Thereby, we can augment pseudo-hrT2 images reflecting different perspectives, which eventually lead to a high-performing segmentation model. Our experimental results on the CrossMoDA challenge show that the proposed method achieved enhanced performance on the vestibular schwannoma and cochlea segmentation.

AB - In this work, we propose a multi-view image translation framework, which can translate contrast-enhanced T1 (ceT1) MR imaging to high-resolution T2 (hrT2) MR imaging for unsupervised vestibular schwannoma and cochlea segmentation. We adopt two image translation models in parallel that use a pixel-level consistent constraint and a patch-level contrastive constraint, respectively. Thereby, we can augment pseudo-hrT2 images reflecting different perspectives, which eventually lead to a high-performing segmentation model. Our experimental results on the CrossMoDA challenge show that the proposed method achieved enhanced performance on the vestibular schwannoma and cochlea segmentation.

KW - Cross-modality

KW - MRI segmentation

KW - Multi-view image translation

KW - Unsupervised domain adaptation

UR - https://www.scopus.com/pages/publications/85185711501

U2 - 10.1007/978-3-031-44153-0_10

DO - 10.1007/978-3-031-44153-0_10

M3 - Conference contribution

AN - SCOPUS:85185711501

SN - 9783031441523

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 100

EP - 108

BT - Brainlesion

A2 - Bakas, Spyridon

A2 - Baid, Ujjwal

A2 - Baheti, Bhakti

A2 - Crimi, Alessandro

A2 - Malec, Sylwia

A2 - Pytlarz, Monika

A2 - Zenk, Maximilian

A2 - Dorent, Reuben

PB - Springer Science and Business Media Deutschland GmbH

T2 - 8th International MICCAI Brainlesion Workshop, BrainLes 2022

Y2 - 18 September 2022 through 18 September 2022

ER -