Deep-Learning-Based Multi-Modal Fusion for Fast MR Reconstruction

Lei Xiang, Yong Chen, Weitang Chang, Yiqiang Zhan, Weili Lin, Qian Wang, Dinggang Shen

Research output: Contribution to journalArticlepeer-review

63 Citations (Scopus)


T1-weighted image (T1WI) and T2-weighted image (T2WI) are the two routinely acquired magnetic resonance (MR) modalities that can provide complementary information for clinical and research usages. However, the relatively long acquisition time makes the acquired image vulnerable to motion artifacts. To speed up the imaging process, various algorithms have been proposed to reconstruct high-quality images from under-sampled k-space data. However, most of the existing algorithms only rely on mono-modality acquisition for the image reconstruction. In this paper, we propose to combine complementary MR acquisitions (i.e., T1WI and under-sampled T2WI particularly) to reconstruct the high-quality image (i.e., corresponding to the fully sampled T2WI). To the best of our knowledge, this is the first work to fuse multi-modal MR acquisitions through deep learning to speed up the reconstruction of a certain target image. Specifically, we present a novel deep learning approach, namely Dense-Unet, to accomplish the reconstruction task. The proposed Dense-Unet requires fewer parameters and less computation, while achieving promising performance. Our results have shown that Dense-Unet can reconstruct a three-dimensional T2WI volume in less than 10 s with an under-sampling rate of 8 for the k-space and negligible aliasing artifacts or signal-noise-ratio loss. Experiments also demonstrate excellent transferring capability of Dense-Unet when applied to the datasets acquired by different MR scanners. The above-mentioned results imply great potential of our method in many clinical scenarios.

Original languageEnglish
Article number8552399
Pages (from-to)2105-2114
Number of pages10
JournalIEEE Transactions on Biomedical Engineering
Issue number7
Publication statusPublished - 2019 Jul


  • Deep learning
  • dense block
  • fast MR reconstruction
  • multi-model fusion

ASJC Scopus subject areas

  • Biomedical Engineering


Dive into the research topics of 'Deep-Learning-Based Multi-Modal Fusion for Fast MR Reconstruction'. Together they form a unique fingerprint.

Cite this