Fast text caption localization on video using visual rhythm

Seong Soo Chun; Hyeokman Kim; Jung Rim Kim; Sangwook Oh; Sanghoon Sull

doi:10.1007/3-540-45925-1_24

Fast text caption localization on video using visual rhythm

Seong Soo Chun, Hyeokman Kim, Jung Rim Kim, Sangwook Oh, Sanghoon Sull

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

11 Citations (Scopus)

Abstract

In this paper, a fast DCT-based algorithm is proposed to efficiently locate text captions embedded on specific areas in a video sequence through visual rhythm, which can be fast constructed by sampling certain portions of a DC image sequence and temporally accumulating the samples along time. Our proposed approach is based on the observations that the text captions carrying important information suitable for indexing often appear on specific areas on video frames, from where sampling strategies are derived for a visual rhythm. Our method then uses a combination of contrast and temporal coherence information on the visual rhythm to detect text frames such that each detected text frame represents consecutive frames containing identical text strings, thus significantly reducing the amount of text frames needed to be examined for text localization from a video sequence. It then utilizes several important properties of text caption to locate the text caption from the detected frames.

Original language	English
Title of host publication	Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings
Editors	Shi-Kuo Chang, Zen Chen, Suh-Yin Lee
Publisher	Springer Verlag
Pages	259-268
Number of pages	10
ISBN (Print)	3540433589
DOIs	https://doi.org/10.1007/3-540-45925-1_24
Publication status	Published - 2002
Event	5th International Conference on Visual Information Systems, VISUAL 2002 - Hsin Chu, Taiwan, Province of China Duration: 2002 Mar 11 → 2002 Mar 13

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	2314
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	5th International Conference on Visual Information Systems, VISUAL 2002
Country/Territory	Taiwan, Province of China
City	Hsin Chu
Period	02/3/11 → 02/3/13

Bibliographical note

Publisher Copyright:
© Springer-Verlag Berlin Heidelberg 2002.

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/3-540-45925-1_24

Cite this

Chun, S. S., Kim, H., Kim, J. R., Oh, S., & Sull, S. (2002). Fast text caption localization on video using visual rhythm. In S.-K. Chang, Z. Chen, & S.-Y. Lee (Eds.), Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings (pp. 259-268). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2314). Springer Verlag. https://doi.org/10.1007/3-540-45925-1_24

Fast text caption localization on video using visual rhythm. / Chun, Seong Soo; Kim, Hyeokman; Kim, Jung Rim et al.
Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings. ed. / Shi-Kuo Chang; Zen Chen; Suh-Yin Lee. Springer Verlag, 2002. p. 259-268 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2314).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chun, SS, Kim, H, Kim, JR, Oh, S & Sull, S 2002, Fast text caption localization on video using visual rhythm. in S-K Chang, Z Chen & S-Y Lee (eds), Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 2314, Springer Verlag, pp. 259-268, 5th International Conference on Visual Information Systems, VISUAL 2002, Hsin Chu, Taiwan, Province of China, 02/3/11. https://doi.org/10.1007/3-540-45925-1_24

Chun SS, Kim H, Kim JR, Oh S, Sull S. Fast text caption localization on video using visual rhythm. In Chang SK, Chen Z, Lee SY, editors, Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings. Springer Verlag. 2002. p. 259-268. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/3-540-45925-1_24

Chun, Seong Soo ; Kim, Hyeokman ; Kim, Jung Rim et al. / Fast text caption localization on video using visual rhythm. Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings. editor / Shi-Kuo Chang ; Zen Chen ; Suh-Yin Lee. Springer Verlag, 2002. pp. 259-268 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{7271fec922144bc38ce222361e25bced,

title = "Fast text caption localization on video using visual rhythm",

abstract = "In this paper, a fast DCT-based algorithm is proposed to efficiently locate text captions embedded on specific areas in a video sequence through visual rhythm, which can be fast constructed by sampling certain portions of a DC image sequence and temporally accumulating the samples along time. Our proposed approach is based on the observations that the text captions carrying important information suitable for indexing often appear on specific areas on video frames, from where sampling strategies are derived for a visual rhythm. Our method then uses a combination of contrast and temporal coherence information on the visual rhythm to detect text frames such that each detected text frame represents consecutive frames containing identical text strings, thus significantly reducing the amount of text frames needed to be examined for text localization from a video sequence. It then utilizes several important properties of text caption to locate the text caption from the detected frames.",

author = "Chun, {Seong Soo} and Hyeokman Kim and Kim, {Jung Rim} and Sangwook Oh and Sanghoon Sull",

note = "Publisher Copyright: {\textcopyright} Springer-Verlag Berlin Heidelberg 2002.; 5th International Conference on Visual Information Systems, VISUAL 2002 ; Conference date: 11-03-2002 Through 13-03-2002",

year = "2002",

doi = "10.1007/3-540-45925-1_24",

language = "English",

isbn = "3540433589",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "259--268",

editor = "Shi-Kuo Chang and Zen Chen and Suh-Yin Lee",

booktitle = "Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings",

}

TY - GEN

T1 - Fast text caption localization on video using visual rhythm

AU - Chun, Seong Soo

AU - Kim, Hyeokman

AU - Kim, Jung Rim

AU - Oh, Sangwook

AU - Sull, Sanghoon

PY - 2002

Y1 - 2002

N2 - In this paper, a fast DCT-based algorithm is proposed to efficiently locate text captions embedded on specific areas in a video sequence through visual rhythm, which can be fast constructed by sampling certain portions of a DC image sequence and temporally accumulating the samples along time. Our proposed approach is based on the observations that the text captions carrying important information suitable for indexing often appear on specific areas on video frames, from where sampling strategies are derived for a visual rhythm. Our method then uses a combination of contrast and temporal coherence information on the visual rhythm to detect text frames such that each detected text frame represents consecutive frames containing identical text strings, thus significantly reducing the amount of text frames needed to be examined for text localization from a video sequence. It then utilizes several important properties of text caption to locate the text caption from the detected frames.

AB - In this paper, a fast DCT-based algorithm is proposed to efficiently locate text captions embedded on specific areas in a video sequence through visual rhythm, which can be fast constructed by sampling certain portions of a DC image sequence and temporally accumulating the samples along time. Our proposed approach is based on the observations that the text captions carrying important information suitable for indexing often appear on specific areas on video frames, from where sampling strategies are derived for a visual rhythm. Our method then uses a combination of contrast and temporal coherence information on the visual rhythm to detect text frames such that each detected text frame represents consecutive frames containing identical text strings, thus significantly reducing the amount of text frames needed to be examined for text localization from a video sequence. It then utilizes several important properties of text caption to locate the text caption from the detected frames.

UR - http://www.scopus.com/inward/record.url?scp=81855176949&partnerID=8YFLogxK

U2 - 10.1007/3-540-45925-1_24

DO - 10.1007/3-540-45925-1_24

M3 - Conference contribution

AN - SCOPUS:81855176949

SN - 3540433589

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 259

EP - 268

BT - Recent Advances in Visual Information Systems - 5th International Conference, VISUAL 2002, Proceedings

A2 - Chang, Shi-Kuo

A2 - Chen, Zen

A2 - Lee, Suh-Yin

PB - Springer Verlag

T2 - 5th International Conference on Visual Information Systems, VISUAL 2002

Y2 - 11 March 2002 through 13 March 2002

ER -

Fast text caption localization on video using visual rhythm

Abstract

Publication series

Other

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this