In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.
Bibliographical noteFunding Information:
Manuscript received April 1, 2017; accepted June 16, 2017. Date of publication July 20, 2017. This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No.B0101-16-0525, Development of global multi-target tracking and event prediction techniques based on real-time large-scale video analysis). (Corresponding author: Sung-Jea Ko.) B.-S. Kim is with School of Electrical Engineering Department, Korea University, Anam-dong, Sungbuk-gu, Seoul, 136-713, Rep. of Korea (e-mail: firstname.lastname@example.org).
© 1975-2011 IEEE.
- Multi-camera systems
- partial seam-updating
- video stitching
ASJC Scopus subject areas
- Media Technology
- Electrical and Electronic Engineering