About AMP Lab Projects Downloads Publications People Links
Motivation and Goal |
When transmitting video data over networks, the video data could suffer from losses. Error concealment is a way to recover or conceal the loss information due to the transmission errors. Through error concealment, the reconstructed video quality can be improved at the decoder end. We want to develop a novel model-based error concealment method that achieves this goal.
Decoder Error Concealment
A flow diagram showing the role of decoder error concealment is shown as follows in Figure 1.
Figure 1. Decoder error concealment
Under the model-based error concealment framework, we propose to use a model: Updating mixture of principal components (UMPC), that captures the non-stationary as well as the multi-modal characteristics of the video data. The model is trained using correctly received video frames (Figure 2). This trained model is then used for reconstructing corrupted video frames (Figure 3).
Figure 2. Updating of multiple principal components (UMPC)
Figure 3. Error concealment using UMPC
The effectiveness of our approach is shown in Figure 4 for the Intra coding scenario. Figure 5 shows the result for the Inter coding scenario. In this work, we focus on the region of interest (ROI) in a video frame, which corresponds to the face region bounded by the white box.
(a) | (b) |
Figure 4. Error concealment for the Intra coding scenario: (a) no concealment; (b) concealment with UMPC
(a) | (b) |
Figure 5. Error concealment for the Inter coding scenario with: (a) motion compensation; (b) motion compensation and UMPC
Publications |
T. P.-C. Chen and T. Chen, "Second-Generation Error Concealment for Video Transport over Error-Prone Channels", to appear in ICIP 2002, Rochester, NY, U.S.A., September 2002.
T. P.-C. Chen and T. Chen, "Updating Mixture of Principal Components for Error Concealment", to appear in ICIP 2002, Rochester, NY, U.S.A., September 2002.
T. P.-C. Chen and T. Chen, "Life After Video Coding Standards: Rate Shaping and Error Concealment", Computer Science series of Springer Verlag for Visual Information System 2002, Hsinchu, Taiwan, March 2002.
Our work is used by |
Computer & Communications Research Labs, Industrial Technology Research Institute http://www.ccl.itri.org.tw/
Any suggestions or comments are welcome. Please send them to Trista Pei-chun Chen.