FUTURE FRAME EXTRAPOLATION USING FUTURE COST VOLUME

Seunggyun Woo, Junheum Park, Chang Su Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A novel future frame extrapolation algorithm using the future cost volume is proposed in this work. First, we develop the future cost volume to estimate motion vectors from a future frame to input frames. Second, we generate two future frame candidates by backward warping the input frames using the future motion vectors. Finally, we develop a synthesis network, which aggregates the two candidates to reconstruct the future frame faithfully. Experimental results demonstrate that the proposed algorithm significantly outperforms state-of-the-art extrapolators on various datasets.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Image Processing, ICIP 2022 - Proceedings
PublisherIEEE Computer Society
Pages1196-1200
Number of pages5
ISBN (Electronic)9781665496209
DOIs
Publication statusPublished - 2022
Event29th IEEE International Conference on Image Processing, ICIP 2022 - Bordeaux, France
Duration: 2022 Oct 162022 Oct 19

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference29th IEEE International Conference on Image Processing, ICIP 2022
Country/TerritoryFrance
CityBordeaux
Period22/10/1622/10/19

Bibliographical note

Funding Information:
This work was supported by the NRF grants funded partly by the Korea government (MSIT) (No. NRF-2021R1A4A1031864 and No. NRF-2022R1A2B5B03002310) and partly by IITP grant funded by the Korea government (MSIT) (No. 2021-0-02068, Artificial Intelligence Innovation Hub).

Publisher Copyright:
© 2022 IEEE.

Keywords

  • future cost volume
  • Future frame extrapolation
  • future motion estimation
  • video frame prediction

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'FUTURE FRAME EXTRAPOLATION USING FUTURE COST VOLUME'. Together they form a unique fingerprint.

Cite this