TY - GEN
T1 - Future Motion Estimation for Video Frame Extrapolation
AU - Woo, Seunggyun
AU - Park, Junheum
AU - Kim, Chang Su
N1 - Funding Information:
ACKNOWLEDGEMENTS This work was supported by the National Research Foundation of Korea (NRF) grants funded by the Korea government (MSIT) (No. NRF-2018R1A2B3003896 and No. NRF-2021R1A4A1031864).
Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - We propose a novel video frame extrapolation algorithm based on future motion estimation. First, we estimate optical flows between a pair of input frames and predict future motions using two schemes: motion doubling and motion mirroring. Then, we forward warp the input frames by employing the two kinds of predicted motion fields, respectively. Finally, we develop a synthesis network to generate a future frame from the warped frames. Experimental results show that the proposed algorithm outperforms recent video frame extrapolation algorithms on various datasets.
AB - We propose a novel video frame extrapolation algorithm based on future motion estimation. First, we estimate optical flows between a pair of input frames and predict future motions using two schemes: motion doubling and motion mirroring. Then, we forward warp the input frames by employing the two kinds of predicted motion fields, respectively. Finally, we develop a synthesis network to generate a future frame from the warped frames. Experimental results show that the proposed algorithm outperforms recent video frame extrapolation algorithms on various datasets.
KW - Video frame extrapolation
KW - future frame synthesis
KW - motion doubling
KW - motion mirroring
UR - http://www.scopus.com/inward/record.url?scp=85128838349&partnerID=8YFLogxK
U2 - 10.1109/ICEIC54506.2022.9748588
DO - 10.1109/ICEIC54506.2022.9748588
M3 - Conference contribution
AN - SCOPUS:85128838349
T3 - 2022 International Conference on Electronics, Information, and Communication, ICEIC 2022
BT - 2022 International Conference on Electronics, Information, and Communication, ICEIC 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 International Conference on Electronics, Information, and Communication, ICEIC 2022
Y2 - 6 February 2022 through 9 February 2022
ER -