Scalable joint segmentation and registration framework for infant brain images

Pei Dong, Li Wang, Weili Lin, Dinggang Shen, Guorong Wu

Research output: Contribution to journalArticlepeer-review

17 Citations (Scopus)


The first year of life is the most dynamic and perhaps the most critical phase of postnatal brain development. The ability to accurately measure structure changes is critical in early brain development study, which highly relies on the performances of image segmentation and registration techniques. However, either infant image segmentation or registration, if deployed independently, encounters much more challenges than segmentation/registration of adult brains due to dynamic appearance change with rapid brain development. In fact, image segmentation and registration of infant images can assists each other to overcome the above challenges by using the growth trajectories (i.e., temporal correspondences) learned from a large set of training subjects with complete longitudinal data. Specifically, a one-year-old image with ground-truth tissue segmentation can be first set as the reference domain. Then, to register the infant image of a new subject at earlier age, we can estimate its tissue probability maps, i.e., with sparse patch-based multi-atlas label fusion technique, where only the training images at the respective age are considered as atlases since they have similar image appearance. Next, these probability maps can be fused as a good initialization to guide the level set segmentation. Thus, image registration between the new infant image and the reference image is free of difficulty of appearance changes, by establishing correspondences upon the reasonably segmented images. Importantly, the segmentation of new infant image can be further enhanced by propagating the much more reliable label fusion heuristics at the reference domain to the corresponding location of the new infant image via the learned growth trajectories, which brings image segmentation and registration to assist each other. It is worth noting that our joint segmentation and registration framework is also flexible to handle the registration of any two infant images even with significant age gap in the first year of life, by linking their joint segmentation and registration through the reference domain. Thus, our proposed joint segmentation and registration method is scalable to various registration tasks in early brain development studies. Promising segmentation and registration results have been achieved for infant brain MR images aged from 2-week-old to 1-year-old, indicating the applicability of our method in early brain development study.

Original languageEnglish
Pages (from-to)54-62
Number of pages9
Publication statusPublished - 2017 Mar 15

Bibliographical note

Funding Information:
This work was supported in part by National Institutes of Health (NIH) grants HD081467, EB006733, EB008374, EB009634, MH100217, AG041721, AG049371, AG042599, CA140413.

Publisher Copyright:
© 2016 Elsevier B.V.


  • Infant brain MR images
  • Joint segmentation and registration
  • Longitudinal growth trajectory
  • Multi-atlas patch based label fusion

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence


Dive into the research topics of 'Scalable joint segmentation and registration framework for infant brain images'. Together they form a unique fingerprint.

Cite this