Content-preserving video stitching method for multi-camera systems

Bo Sang Kim; Kang A. Choi; Won Jae Park; Seung Wook Kim; Sung Jea Ko

doi:10.1109/TCE.2017.014841

Content-preserving video stitching method for multi-camera systems

Bo Sang Kim, Kang A. Choi, Won Jae Park, Seung Wook Kim, Sung Jea Ko

School of Electrical Engineering

Research output: Contribution to journal › Article › peer-review

18 Citations (Scopus)

Abstract

In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

Original language	English
Article number	8013249
Pages (from-to)	109-116
Number of pages	8
Journal	IEEE Transactions on Consumer Electronics
Volume	63
Issue number	2
DOIs	https://doi.org/10.1109/TCE.2017.014841
Publication status	Published - 2017 May

Bibliographical note

Funding Information:
Manuscript received April 1, 2017; accepted June 16, 2017. Date of publication July 20, 2017. This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No.B0101-16-0525, Development of global multi-target tracking and event prediction techniques based on real-time large-scale video analysis). (Corresponding author: Sung-Jea Ko.) B.-S. Kim is with School of Electrical Engineering Department, Korea University, Anam-dong, Sungbuk-gu, Seoul, 136-713, Rep. of Korea (e-mail: [email protected]).

Publisher Copyright:
© 1975-2011 IEEE.

Keywords

Multi-camera systems
content-preserving
partial seam-updating
seam-finding
video stitching

ASJC Scopus subject areas

Media Technology
Electrical and Electronic Engineering

Access to Document

10.1109/TCE.2017.014841

Cite this

@article{cca61ab2ee654a978ebd0fa11b44ba09,

title = "Content-preserving video stitching method for multi-camera systems",

abstract = "In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.",

keywords = "Multi-camera systems, content-preserving, partial seam-updating, seam-finding, video stitching",

author = "Kim, {Bo Sang} and Choi, {Kang A.} and Park, {Won Jae} and Kim, {Seung Wook} and Ko, {Sung Jea}",

note = "Funding Information: Manuscript received April 1, 2017; accepted June 16, 2017. Date of publication July 20, 2017. This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No.B0101-16-0525, Development of global multi-target tracking and event prediction techniques based on real-time large-scale video analysis). (Corresponding author: Sung-Jea Ko.) B.-S. Kim is with School of Electrical Engineering Department, Korea University, Anam-dong, Sungbuk-gu, Seoul, 136-713, Rep. of Korea (e-mail: [email protected]). Publisher Copyright: {\textcopyright} 1975-2011 IEEE.",

year = "2017",

month = may,

doi = "10.1109/TCE.2017.014841",

language = "English",

volume = "63",

pages = "109--116",

journal = "IEEE Transactions on Consumer Electronics",

issn = "0098-3063",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "2",

}

TY - JOUR

T1 - Content-preserving video stitching method for multi-camera systems

AU - Kim, Bo Sang

AU - Choi, Kang A.

AU - Park, Won Jae

AU - Kim, Seung Wook

AU - Ko, Sung Jea

N1 - Funding Information: Manuscript received April 1, 2017; accepted June 16, 2017. Date of publication July 20, 2017. This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No.B0101-16-0525, Development of global multi-target tracking and event prediction techniques based on real-time large-scale video analysis). (Corresponding author: Sung-Jea Ko.) B.-S. Kim is with School of Electrical Engineering Department, Korea University, Anam-dong, Sungbuk-gu, Seoul, 136-713, Rep. of Korea (e-mail: [email protected]). Publisher Copyright: © 1975-2011 IEEE.

PY - 2017/5

Y1 - 2017/5

N2 - In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

AB - In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

KW - Multi-camera systems

KW - content-preserving

KW - partial seam-updating

KW - seam-finding

KW - video stitching

UR - http://www.scopus.com/inward/record.url?scp=85028941017&partnerID=8YFLogxK

U2 - 10.1109/TCE.2017.014841

DO - 10.1109/TCE.2017.014841

M3 - Article

AN - SCOPUS:85028941017

SN - 0098-3063

VL - 63

SP - 109

EP - 116

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

IS - 2

M1 - 8013249

ER -

Content-preserving video stitching method for multi-camera systems

Abstract

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this