Multi-modal latent space inducing ensemble SVM classifier for early dementia diagnosis with neuroimaging data

Tao Zhou, Kim Han Thung, Mingxia Liu, Feng Shi, Changqing Zhang, Dinggang Shen

Research output: Contribution to journalArticlepeer-review

61 Citations (Scopus)


Fusing multi-modality data is crucial for accurate identification of brain disorder as different modalities can provide complementary perspectives of complex neurodegenerative disease. However, there are at least four common issues associated with the existing fusion methods. First, many existing fusion methods simply concatenate features from each modality without considering the correlations among different modalities. Second, most existing methods often make prediction based on a single classifier, which might not be able to address the heterogeneity of the Alzheimer's disease (AD) progression. Third, many existing methods often employ feature selection (or reduction) and classifier training in two independent steps, without considering the fact that the two pipelined steps are highly related to each other. Forth, there are missing neuroimaging data for some of the participants (e.g., missing PET data), due to the participants’ “no-show” or dropout. In this paper, to address the above issues, we propose an early AD diagnosis framework via novel multi-modality latent space inducing ensemble SVM classifier. Specifically, we first project the neuroimaging data from different modalities into a latent space, and then map the learned latent representations into the label space to learn multiple diversified classifiers. Finally, we obtain the more reliable classification results by using an ensemble strategy. More importantly, we present a Complete Multi-modality Latent Space (CMLS) learning model for complete multi-modality data and also an Incomplete Multi-modality Latent Space (IMLS) learning model for incomplete multi-modality data. Extensive experiments using the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset have demonstrated that our proposed models outperform other state-of-the-art methods.

Original languageEnglish
Article number101630
JournalMedical Image Analysis
Publication statusPublished - 2020 Feb

Bibliographical note

Publisher Copyright:
© 2019


  • Alzheimer's disease (AD)
  • Latent space
  • Missing modality
  • Multi-modality data
  • Multiple diversified classifiers

ASJC Scopus subject areas

  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging
  • Computer Vision and Pattern Recognition
  • Health Informatics
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Multi-modal latent space inducing ensemble SVM classifier for early dementia diagnosis with neuroimaging data'. Together they form a unique fingerprint.

Cite this