One-shot generative adversarial learning for MRI segmentation of craniomaxillofacial bony structures

Xu Chen, James J. Xia, Dinggang Shen, Chunfeng Lian, Li Wang, Hannah Deng, Steve H. Fung, Dong Nie, Kim Han Thung, Pew Thian Yap, Jaime Gateno

Research output: Contribution to journalArticlepeer-review

27 Citations (Scopus)


Compared to computed tomography (CT), magnetic resonance imaging (MRI) delineation of craniomaxillofacial (CMF) bony structures can avoid harmful radiation exposure. However, bony boundaries are blurry in MRI, and structural information needs to be borrowed from CT during the training. This is challenging since paired MRI-CT data are typically scarce. In this paper, we propose to make full use of unpaired data, which are typically abundant, along with a single paired MRI-CT data to construct a one-shot generative adversarial model for automated MRI segmentation of CMF bony structures. Our model consists of a cross-modality image synthesis sub-network, which learns the mapping between CT and MRI, and an MRI segmentation sub-network. These two sub-networks are trained jointly in an end-to-end manner. Moreover, in the training phase, a neighbor-based anchoring method is proposed to reduce the ambiguity problem inherent in cross-modality synthesis, and a feature-matching-based semantic consistency constraint is proposed to encourage segmentation-oriented MRI synthesis. Experimental results demonstrate the superiority of our method both qualitatively and quantitatively in comparison with the state-of-the-art MRI segmentation methods.

Original languageEnglish
Article number8798866
Pages (from-to)787-796
Number of pages10
JournalIEEE Transactions on Medical Imaging
Issue number3
Publication statusPublished - 2020 Mar

Bibliographical note

Funding Information:
Manuscript received June 13, 2019; revised August 8, 2019; accepted August 11, 2019. Date of publication August 14, 2019; date of current version February 28, 2020. This work was supported by the NIH/NIDCR Grants (DE027251 and DE022676). (Corresponding authors: James J. Xia; Dinggang Shen.) X. Chen, C. Lian, L. Wang, D. Nie, K.-H. Thung, and P.-T. Yap are with the Department of Radiology and Biomedical Research Imaging Center, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA.

Publisher Copyright:
© 1982-2012 IEEE.


  • Craniomaxillofacial bone segmentation
  • MRI
  • generative adversarial learning
  • one-shot learning

ASJC Scopus subject areas

  • Software
  • Radiological and Ultrasound Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'One-shot generative adversarial learning for MRI segmentation of craniomaxillofacial bony structures'. Together they form a unique fingerprint.

Cite this