Reflection Removal under Fast Forward Camera Motion

Jun Young Cheong, Christian Simon, Chang-Su Kim, In Kyu Park

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)


The image quality of an in-vehicle black box camera is often degraded by the reflections of internal objects, dirt, and dust on the windshield. In this paper, we propose a novel algorithm that simultaneously removes the reflections and small dirt artifacts from in-vehicle black box videos under fast forward camera motion. The algorithm exploits the spatiotemporal coherence of the reflection and dirt, which remain stationary relative to the fast-moving background. Unlike previous algorithms, the algorithm first separates stationary reflection and then restores the background scene. To this end, we propose an average image prior, thereby imposing spatiotemporal coherence. The separation model is a two-layer model composed of stationary and background layers, where different gradient sparsity distributions are utilized in a region-based manner. Motion compensation in postprocessing is proposed to alleviate layer jitter due to vehicle vibrations. In evaluation experiments, the proposed algorithm successfully extracts the stationary layer from several real and synthetic black box videos.

Original languageEnglish
Article number8024024
Pages (from-to)6061-6073
Number of pages13
JournalIEEE Transactions on Image Processing
Issue number12
Publication statusPublished - 2017 Dec

Bibliographical note

Funding Information:
Manuscript received March 4, 2017; revised July 18, 2017; accepted August 28, 2017. Date of publication September 1, 2017; date of current version October 3, 2017. This work was supported by the National Research Foundation of Korea (NRF) through the Korea Government (MSIT) under Grant NRF-2016R1A2B4014731. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Lei Zhang. (Corresponding author: In Kyu Park.) J. Y. Cheong, C. Simon, and I. K. Park are with the Department of Information and Communication Engineering, Inha University, Incheon 22212, South Korea (e-mail:

Publisher Copyright:
© 1992-2012 IEEE.


  • Black box camera
  • average image prior
  • dirt removal
  • fast forward motion
  • layer separation
  • reflection removal

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Reflection Removal under Fast Forward Camera Motion'. Together they form a unique fingerprint.

Cite this