Region-Adaptive Deformable Registration of CT/MRI Pelvic Images via Learning-Based Image Synthesis

Xiaohuan Cao, Jianhua Yang, Yaozong Gao, Qian Wang, DInggang Shen

Research output: Contribution to journalArticlepeer-review

35 Citations (Scopus)


Registration of pelvic computed tomography (CT) and magnetic resonance imaging (MRI) is highly desired as it can facilitate effective fusion of two modalities for prostate cancer radiation therapy, i.e., using CT for dose planning and MRI for accurate organ delineation. However, due to the large intermodality appearance gaps and the high shape/appearance variations of pelvic organs, the pelvic CT/MRI registration is highly challenging. In this paper, we propose a region-adaptive deformable registration method for multimodal pelvic image registration. Specifically, to handle the large appearance gaps, we first perform both CT-to-MRI and MRI-to-CT image synthesis by multi-target regression forest. Then, to use the complementary anatomical information in the two modalities for steering the registration, we select key points automatically from both modalities and use them together for guiding correspondence detection in the region-adaptive fashion. That is, we mainly use CT to establish correspondences for bone regions, and use MRI to establish correspondences for soft tissue regions. The number of key points is increased gradually during the registration, to hierarchically guide the symmetric estimation of the deformation fields. Experiments for both intra-subject and inter-subject deformable registration show improved performances compared with the state-of-the-art multimodal registration methods, which demonstrate the potentials of our method to be applied for the routine prostate cancer radiation therapy.

Original languageEnglish
Pages (from-to)3500-3512
Number of pages13
JournalIEEE Transactions on Image Processing
Issue number7
Publication statusPublished - 2018 Jul


  • Image synthesis
  • learning-based registration
  • multi-modal registration
  • radiation therapy

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Region-Adaptive Deformable Registration of CT/MRI Pelvic Images via Learning-Based Image Synthesis'. Together they form a unique fingerprint.

Cite this