Asymmetric Bilateral Motion Estimation for Video Frame Interpolation

Junheum Park, Chul Lee, Chang Su Kim

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    129 Citations (Scopus)

    Abstract

    We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.

    Original languageEnglish
    Title of host publicationProceedings - 2021 IEEE/CVF International Conference on Computer Vision, ICCV 2021
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages14519-14528
    Number of pages10
    ISBN (Electronic)9781665428125
    DOIs
    Publication statusPublished - 2021
    Event18th IEEE/CVF International Conference on Computer Vision, ICCV 2021 - Virtual, Online, Canada
    Duration: 2021 Oct 112021 Oct 17

    Publication series

    NameProceedings of the IEEE International Conference on Computer Vision
    ISSN (Print)1550-5499

    Conference

    Conference18th IEEE/CVF International Conference on Computer Vision, ICCV 2021
    Country/TerritoryCanada
    CityVirtual, Online
    Period21/10/1121/10/17

    Bibliographical note

    Funding Information:
    This work was supported by the National Research Foundation of Korea (NRF) grants funded by the Korea government (MSIT) (Nos. NRF-2018R1A2B3003896, NRF-2019R1A2C4069806, and NRF-2021R1A4A1031864).

    Publisher Copyright:
    © 2021 IEEE

    ASJC Scopus subject areas

    • Software
    • Computer Vision and Pattern Recognition

    Fingerprint

    Dive into the research topics of 'Asymmetric Bilateral Motion Estimation for Video Frame Interpolation'. Together they form a unique fingerprint.

    Cite this