Blur-Robust Object Detection Using Feature-Level Deblurring via Self-Guided Knowledge Distillation

Sung Jin Cho, Seung Wook Kim, Seung Won Jung, Sung Jea Ko

    Research output: Contribution to journalArticlepeer-review

    6 Citations (Scopus)

    Abstract

    Images captured from real-world environments often include blur artifacts resulting from camera movement, dynamic object motion, or out-of-focus. Although such blur artifacts are inevitable, most object detection methods do not have special considerations for them; therefore, they may fail to detect objects in blurry images. One possible solution is applying image deblurring prior to object detection. However, this solution is computationally demanding and its performance heavily depends on image deblurring results. In this study, we propose a novel blur-aware object detection framework. First, we construct a synthetic but realistic dataset by applying a diverse set of motion blur kernels to blur-free images. Subsequently, we leverage self-guided knowledge distillation between the teacher and student networks that perform object detection using blur-free and blurry images, respectively. The teacher and student networks share most of their network parameters and jointly learn in a fully-supervised manner. The teacher network provides image features as hints for feature-level deblurring and also renders soft labels for the training of the student network. Guided by the hints and the soft labels from the teacher, the student network learns and expands their knowledge on object detection in blurry images. Experimental results show that the proposed framework improves the robustness of several widely used object detectors against image blurs.

    Original languageEnglish
    Pages (from-to)79491-79501
    Number of pages11
    JournalIEEE Access
    Volume10
    DOIs
    Publication statusPublished - 2022

    Bibliographical note

    Funding Information:
    This work was supported by Institute of Information and Communications Technology Planning and Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2014-3-00077-008, Development of global multi-target tracking and event prediction techniques based on real-time large-scale video analysis).

    Publisher Copyright:
    © 2013 IEEE.

    Keywords

    • Object detection
    • convolutional neural network
    • deblurring
    • deep learning

    ASJC Scopus subject areas

    • General Computer Science
    • General Materials Science
    • General Engineering
    • Electrical and Electronic Engineering

    Fingerprint

    Dive into the research topics of 'Blur-Robust Object Detection Using Feature-Level Deblurring via Self-Guided Knowledge Distillation'. Together they form a unique fingerprint.

    Cite this