Joint patch clustering-based dictionary learning for multimodal image fusion

Minjae Kim, David K. Han, Hanseok Ko

Research output: Contribution to journalArticlepeer-review

162 Citations (Scopus)


Constructing a good dictionary is the key to a successful image fusion technique in sparsity-based models. An efficient dictionary learning method based on a joint patch clustering is proposed for multimodal image fusion. To construct an over-complete dictionary to ensure sufficient number of useful atoms for representing a fused image, which conveys image information from different sensor modalities, all patches from different source images are clustered together with their structural similarities. For constructing a compact but informative dictionary, only a few principal components that effectively describe each of joint patch clusters are selected and combined to form the over-complete dictionary. Finally, sparse coefficients are estimated by a simultaneous orthogonal matching pursuit algorithm to represent multimodal images with the common dictionary learned by the proposed method. The experimental results with various pairs of source images validate effectiveness of the proposed method for image fusion task.

Original languageEnglish
Pages (from-to)198-214
Number of pages17
JournalInformation Fusion
Publication statusPublished - 2016 Jan 1


  • Clustering
  • Dictionary learning
  • K-SVD
  • Multimodal image fusion
  • Sparse representation

ASJC Scopus subject areas

  • Signal Processing
  • Software
  • Hardware and Architecture
  • Information Systems


Dive into the research topics of 'Joint patch clustering-based dictionary learning for multimodal image fusion'. Together they form a unique fingerprint.

Cite this