TY - GEN
T1 - Deep learning approach to video frame rate up-conversion using bilateral motion estimation
AU - Park, Junheum
AU - Lee, Chul
AU - Kim, Chang Su
PY - 2019/11
Y1 - 2019/11
N2 - We propose a deep learning-based frame rate upconversion algorithm using bilateral motion estimation. We first estimate bilateral motion fields by employing a convolutional neural network. Also, we approximate intermediate bi-directional motion fields, assuming linear motions between successive frames. Finally, we develop the synthesis network to produce an intermediate frame by merging the warped frames, which are obtained using the two kinds of motion fields. Experimental results demonstrate that the proposed algorithm generates high-quality intermediate frames on challenging sequences with large motions and occlusion, and outperforms state-of-the-art conventional algorithms.
AB - We propose a deep learning-based frame rate upconversion algorithm using bilateral motion estimation. We first estimate bilateral motion fields by employing a convolutional neural network. Also, we approximate intermediate bi-directional motion fields, assuming linear motions between successive frames. Finally, we develop the synthesis network to produce an intermediate frame by merging the warped frames, which are obtained using the two kinds of motion fields. Experimental results demonstrate that the proposed algorithm generates high-quality intermediate frames on challenging sequences with large motions and occlusion, and outperforms state-of-the-art conventional algorithms.
UR - http://www.scopus.com/inward/record.url?scp=85082381601&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082381601&partnerID=8YFLogxK
U2 - 10.1109/APSIPAASC47483.2019.9023270
DO - 10.1109/APSIPAASC47483.2019.9023270
M3 - Conference contribution
T3 - 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019
SP - 1970
EP - 1975
BT - 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019
Y2 - 18 November 2019 through 21 November 2019
ER -