Low complexity content-aware video retargeting for mobile devices

Hyeong Min Nam; Keun Yung Byun; Jae Yun Jeong; Kang Sun Choi; Sung Jea Ko

doi:10.1109/TCE.2010.5439143

Low complexity content-aware video retargeting for mobile devices

Hyeong Min Nam, Keun Yung Byun, Jae Yun Jeong, Kang Sun Choi, Sung Jea Ko

Research output: Contribution to journal › Article › peer-review

13 Citations (Scopus)

Abstract

In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the onedimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods¹.

Original language	English
Article number	5439143
Pages (from-to)	182-189
Number of pages	8
Journal	IEEE Transactions on Consumer Electronics
Volume	56
Issue number	1
DOIs	https://doi.org/10.1109/TCE.2010.5439143
Publication status	Published - 2010 Feb

Bibliographical note

Funding Information:
This work was supported by the Korea Science and Engineering Foundation (KOSEF) grant funded by the Korea government (MEST) (No. 2009-0080547).

Funding Information:
1This research was supported by Seoul Future Contents Convergence (SFCC) Cluster established by Seoul R&BD Program (No. 10570).

Keywords

Compressed domain processing
Content-aware
Low complexity
Seam carving
Video retargeting

ASJC Scopus subject areas

Media Technology
Electrical and Electronic Engineering

Access to Document

10.1109/TCE.2010.5439143

Cite this

@article{349a8cf02c7847a2b2b81ab351ac298f,

title = "Low complexity content-aware video retargeting for mobile devices",

abstract = "In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the onedimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods1.",

keywords = "Compressed domain processing, Content-aware, Low complexity, Seam carving, Video retargeting",

author = "Nam, {Hyeong Min} and Byun, {Keun Yung} and Jeong, {Jae Yun} and Choi, {Kang Sun} and Ko, {Sung Jea}",

note = "Funding Information: This work was supported by the Korea Science and Engineering Foundation (KOSEF) grant funded by the Korea government (MEST) (No. 2009-0080547). Funding Information: 1This research was supported by Seoul Future Contents Convergence (SFCC) Cluster established by Seoul R&BD Program (No. 10570).",

year = "2010",

month = feb,

doi = "10.1109/TCE.2010.5439143",

language = "English",

volume = "56",

pages = "182--189",

journal = "IEEE Transactions on Consumer Electronics",

issn = "0098-3063",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "1",

}

TY - JOUR

T1 - Low complexity content-aware video retargeting for mobile devices

AU - Nam, Hyeong Min

AU - Byun, Keun Yung

AU - Jeong, Jae Yun

AU - Choi, Kang Sun

AU - Ko, Sung Jea

N1 - Funding Information: This work was supported by the Korea Science and Engineering Foundation (KOSEF) grant funded by the Korea government (MEST) (No. 2009-0080547). Funding Information: 1This research was supported by Seoul Future Contents Convergence (SFCC) Cluster established by Seoul R&BD Program (No. 10570).

PY - 2010/2

Y1 - 2010/2

N2 - In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the onedimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods1.

AB - In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the onedimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods1.

KW - Compressed domain processing

KW - Content-aware

KW - Low complexity

KW - Seam carving

KW - Video retargeting

UR - http://www.scopus.com/inward/record.url?scp=77950678556&partnerID=8YFLogxK

U2 - 10.1109/TCE.2010.5439143

DO - 10.1109/TCE.2010.5439143

M3 - Article

AN - SCOPUS:77950678556

SN - 0098-3063

VL - 56

SP - 182

EP - 189

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

IS - 1

M1 - 5439143

ER -

Low complexity content-aware video retargeting for mobile devices

Abstract

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this