Deep Color Constancy Using Spatio-Temporal Correlation of High-Speed Video

Dong Jae Lee, Kang Kyu Lee, Jong Ok Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

After the invention of electric bulbs, most of lights surrounding our worlds are powered by alternative current (AC). This intensity variation can be captured with a high-speed camera, and we can utilize the intensity difference between consecutive video frames for various vision tasks. For color constancy, conventional methods usually focus on exploiting only the spatial feature. To overcome the limitations of conventional methods, a couple of methods to utilize AC flickering have been proposed. The previous work employed temporal correlation between high-speed video frames. To further enhance the previous work, we propose a deep spatio-temporal color constancy method using spatial and temporal correlations. To extract temporal features for illuminant estimation, we calculate the temporal correlation between feature maps where global features as well as local are learned. By learning global features through spatio-temporal correlation, the proposed method can estimate illumination more accurately, and is particularly robust to noisy practical environments. The experimental results demonstrate that the performance of the proposed method is superior to that of existing methods.

Original languageEnglish
Title of host publication2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728185514
DOIs
Publication statusPublished - 2021
Event2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Munich, Germany
Duration: 2021 Dec 52021 Dec 8

Publication series

Name2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings

Conference

Conference2021 International Conference on Visual Communications and Image Processing, VCIP 2021
Country/TerritoryGermany
CityMunich
Period21/12/521/12/8

Keywords

  • AC light
  • High-speed video
  • Spatio-temporal correlation
  • Temporal color constancy

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Sensory Systems
  • Communication

Fingerprint

Dive into the research topics of 'Deep Color Constancy Using Spatio-Temporal Correlation of High-Speed Video'. Together they form a unique fingerprint.

Cite this