Anatomy-Regularized Representation Learning for Cross-Modality Medical Image Segmentation

Xu Chen, Chunfeng Lian, Li Wang, Hannah Deng, Tianshu Kuang, Steve Fung, Jaime Gateno, Pew Thian Yap, James J. Xia, DInggang Shen

    Research output: Contribution to journalArticlepeer-review

    31 Citations (Scopus)

    Abstract

    An increasing number of studies are leveraging unsupervised cross-modality synthesis to mitigate the limited label problem in training medical image segmentation models. They typically transfer ground truth annotations from a label-rich imaging modality to a label-lacking imaging modality, under an assumption that different modalities share the same anatomical structure information. However, since these methods commonly use voxel/pixel-wise cycle-consistency to regularize the mappings between modalities, high-level semantic information is not necessarily preserved. In this paper, we propose a novel anatomy-regularized representation learning approach for segmentation-oriented cross-modality image synthesis. It learns a common feature encoding across different modalities to form a shared latent space, where 1) the input and its synthesis present consistent anatomical structure information, and 2) the transformation between two images in one domain is preserved by their syntheses in another domain. We applied our method to the tasks of cross-modality skull segmentation and cardiac substructure segmentation. Experimental results demonstrate the superiority of our method in comparison with state-of-the-art cross-modality medical image segmentation methods.

    Original languageEnglish
    Article number9201096
    Pages (from-to)274-285
    Number of pages12
    JournalIEEE Transactions on Medical Imaging
    Volume40
    Issue number1
    DOIs
    Publication statusPublished - 2021 Jan

    Bibliographical note

    Publisher Copyright:
    © 1982-2012 IEEE.

    Keywords

    • Representation learning
    • cross-modality image synthesis
    • medical image segmentation

    ASJC Scopus subject areas

    • Software
    • Radiological and Ultrasound Technology
    • Computer Science Applications
    • Electrical and Electronic Engineering

    Fingerprint

    Dive into the research topics of 'Anatomy-Regularized Representation Learning for Cross-Modality Medical Image Segmentation'. Together they form a unique fingerprint.

    Cite this