Content-preserving video stitching method for multi-camera systems

Bo Sang Kim, Kang A. Choi, Won Jae Park, Seung Wook Kim, Sung Jea Ko

Research output: Contribution to journalArticlepeer-review

18 Citations (Scopus)

Abstract

In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

Original languageEnglish
Article number8013249
Pages (from-to)109-116
Number of pages8
JournalIEEE Transactions on Consumer Electronics
Volume63
Issue number2
DOIs
Publication statusPublished - 2017 May

Bibliographical note

Funding Information:
Manuscript received April 1, 2017; accepted June 16, 2017. Date of publication July 20, 2017. This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No.B0101-16-0525, Development of global multi-target tracking and event prediction techniques based on real-time large-scale video analysis). (Corresponding author: Sung-Jea Ko.) B.-S. Kim is with School of Electrical Engineering Department, Korea University, Anam-dong, Sungbuk-gu, Seoul, 136-713, Rep. of Korea (e-mail: bskim@dali.korea.ac.kr).

Publisher Copyright:
© 1975-2011 IEEE.

Keywords

  • Multi-camera systems
  • content-preserving
  • partial seam-updating
  • seam-finding
  • video stitching

ASJC Scopus subject areas

  • Media Technology
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Content-preserving video stitching method for multi-camera systems'. Together they form a unique fingerprint.

Cite this