TY - JOUR
T1 - Prioritized image and video colorization based on Gaussian pyramid of gradient images
AU - Hyun, Dae Young
AU - Heu, Jun Hee
AU - Kim, Chang-Su
AU - Lee, Sang Uk
N1 - Funding Information:
This research was supported partly by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (MEST) (No. 2011-0027328), and partly by (No. 2012-0005410).
PY - 2012/4
Y1 - 2012/4
N2 - We propose a colorization algorithm for grayscale images and videos that demands simple user scribbles on a selected set of source pixels. The proposed algorithm colorizes non source pixels by propagating the colors of source pixels. To achieve reliable colorization results, we adopt a prioritization approach, which colorizes large smooth regions first and small detailed regions later using a Gaussian pyramid of gradient images. At each level of the pyramid, we determine the priority of each non source pixel using the luminance similarities to neighboring pixels and the geometric proximities to source pixels. Then we repeatedly colorize the pixel with the highest priority by interpolating the colors of neighboring source pixels. Also, for video colorization, the proposed algorithm transfers the colors of the first frame to subsequent frames based on optical flow estimation. To correct incorrectly transferred colors, the accuracies of transferred colors are calculated, and inaccurate colors are refined using neighboring colors. Simulation results show that the proposed algorithm provides accurate and reliable colorization results. We also demonstrate that the proposed algorithm can be used for color restoration and recolorization.
AB - We propose a colorization algorithm for grayscale images and videos that demands simple user scribbles on a selected set of source pixels. The proposed algorithm colorizes non source pixels by propagating the colors of source pixels. To achieve reliable colorization results, we adopt a prioritization approach, which colorizes large smooth regions first and small detailed regions later using a Gaussian pyramid of gradient images. At each level of the pyramid, we determine the priority of each non source pixel using the luminance similarities to neighboring pixels and the geometric proximities to source pixels. Then we repeatedly colorize the pixel with the highest priority by interpolating the colors of neighboring source pixels. Also, for video colorization, the proposed algorithm transfers the colors of the first frame to subsequent frames based on optical flow estimation. To correct incorrectly transferred colors, the accuracies of transferred colors are calculated, and inaccurate colors are refined using neighboring colors. Simulation results show that the proposed algorithm provides accurate and reliable colorization results. We also demonstrate that the proposed algorithm can be used for color restoration and recolorization.
UR - http://www.scopus.com/inward/record.url?scp=84906761807&partnerID=8YFLogxK
U2 - 10.1117/1.JEI.21.2.023027
DO - 10.1117/1.JEI.21.2.023027
M3 - Article
AN - SCOPUS:84906761807
SN - 1017-9909
VL - 21
JO - Journal of Electronic Imaging
JF - Journal of Electronic Imaging
IS - 2
M1 - 023027
ER -