Advanced Multimedia Processing Lab -- Projects -- Decoder Error Concealment

            About AMP Lab        Projects        Downloads        Publications        People        Links

Project - Decoder Error Concealment

Contents

 

Team Member

Trista Pei-chun Chen

peichun@andrew.cmu.edu

Top of this page

                                  

Motivation and Goal

When transmitting video data over networks, the video data could suffer from losses. Error concealment is a way to recover or conceal the loss information due to the transmission errors. Through error concealment, the reconstructed video quality can be improved at the decoder end. We want to develop a novel model-based error concealment method that achieves this goal.

Top of this page

 

System Description

Decoder Error Concealment

A flow diagram showing the role of decoder error concealment is shown as follows in Figure 1.

Figure 1. Decoder error concealment

Under the model-based error concealment framework, we propose to use a model: Updating mixture of principal components (UMPC), that captures the non-stationary as well as the multi-modal characteristics of the video data. The model is trained using correctly received video frames (Figure 2). This trained model is then used for reconstructing corrupted video frames (Figure 3).

Figure 2. Updating of multiple principal components (UMPC)

Figure 3. Error concealment using UMPC

The effectiveness of our approach is shown in Figure 4 for the Intra coding scenario. Figure 5 shows the result for the Inter coding scenario. In this work, we focus on the region of interest (ROI) in a video frame, which corresponds to the face region bounded by the white box.

(a) (b)

Figure 4. Error concealment for the Intra coding scenario: (a) no concealment; (b) concealment with UMPC

(a) (b)

Figure 5. Error concealment for the Inter coding scenario with: (a) motion compensation; (b) motion compensation and  UMPC

Top of this page

 

Publications

Top of this page

 

Our work is used by

Top of this page

 

Contact

Any suggestions or comments are welcome. Please send them to Trista Pei-chun Chen

Top of this page