Correspondence matching of multi-view video sequences using mutual information based similarity measure

Soon Young Lee, Jae Young Sim, Chang-Su Kim, Sang Uk Lee

    Research output: Contribution to journalArticlepeer-review

    24 Citations (Scopus)

    Abstract

    We propose a correspondence matching algorithm for multi-view video sequences, which provides reliable performance even when the multiple cameras have significantly different parameters, such as viewing angles and positions. We use an activity vector, which represents the temporal occurrence pattern of moving foreground objects at a pixel position, as an invariant feature for correspondence matching. We first devise a novel similarity measure between activity vectors by considering the joint and individual behavior of the activity vectors. Specifically, we define random variables associated with the activity vectors and measure their similarity using the mutual information between the random variables. Moreover, to find a reliable homography transform between views, we find consistent pixel positions by employing the iterative bidirectional matching. We also refine the matching results of multiple source pixel positions by minimizing a matching cost function based on the Markov random field. Experimental results show that the proposed algorithm provides more accurate and reliable matching performance than the conventional activity-based and feature-based matching algorithms, and therefore can facilitate various applications of visual sensor networks.

    Original languageEnglish
    Article number6553124
    Pages (from-to)1719-1731
    Number of pages13
    JournalIEEE Transactions on Multimedia
    Volume15
    Issue number8
    DOIs
    Publication statusPublished - 2013

    Keywords

    • Correspondence matching
    • Markov random field
    • Multi-view videos
    • Mutual information based similarity measure
    • Visual sensor networks

    ASJC Scopus subject areas

    • Signal Processing
    • Media Technology
    • Computer Science Applications
    • Electrical and Electronic Engineering

    Fingerprint

    Dive into the research topics of 'Correspondence matching of multi-view video sequences using mutual information based similarity measure'. Together they form a unique fingerprint.

    Cite this