Robust MMSE video decoding: Theory and practical implementations

Chang Su Kim, Jongwon Kim, Ioannis Katsavounidis, C. C. Jay Kuo

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)


A novel video decoding algorithm based on the minimum mean square error (MMSE) criterion is investigated in this research. To alleviate the effect of transmission errors, we first develop an error propagation model to estimate and track the mean square error (MSE) of each pixel in the decoder. Then, the proposed video decoding algorithm adjusts the reconstruction of each pixel adaptively according to fluctuating channel conditions. More specifically, the decoder reconstructs a pixel in the kth frame Fk by using a weighted sum of two pixels in frames Fk-1 and Fk-2, respectively, where their weights are adaptively selected to minimize the MSE of the reconstructed pixel by using the error propagation model. Extensive simulation results performed on standard H.263 bit streams demonstrate that the MMSE-based concealment algorithm yields a better performance than the conventional method, even if the encoder transmits a single motion vector per block. Moreover, the proposed MMSE decoding algorithm significantly enhances the error resilient capability of the double-vector motion compensation (DMC) algorithm, where two motion vectors are sent per block.

Original languageEnglish
Pages (from-to)39-50
Number of pages12
JournalIEEE Transactions on Circuits and Systems for Video Technology
Issue number1
Publication statusPublished - 2005 Jan
Externally publishedYes

Bibliographical note

Funding Information:
Manuscript received May 21, 2002; revised June 5, 2003. This work was supported in part by InterVideo, Inc. This paper was recommended by Associate Editor Q. Tian. C.-S. Kim is with the Department of Information Engineering, Chinese University of Hong Kong, Shatin, Hong Kong (e-mail: J. Kim is with the Department of Information and Communications, Kwangju Institute of Science and Technology, Kwangju 500-712, Korea (e-mail: I. Katsavounidis is with InterVideo Inc., Fremont, CA 94539 USA (e-mail: C.-C. J. Kuo is with the Department of Electrical Engineering, University of Southern California, Los Angeles, CA 90089-2564 USA (e-mail: Digital Object Identifier 10.1109/TCSVT.2004.839994


  • Double-vector motion compensation
  • Error concealment
  • H.263
  • Minimum mean square error (MMSE) decoding
  • Robust video transmission

ASJC Scopus subject areas

  • Media Technology
  • Electrical and Electronic Engineering


Dive into the research topics of 'Robust MMSE video decoding: Theory and practical implementations'. Together they form a unique fingerprint.

Cite this