A Region based Multiple Frame-rate Tradeoff of Video Streaming (TP-P3)

Author(s) : Wei Lai (University of Science and Technology of China, China) Xiaodong Gu (Microsoft Research Asia, China) RenHua Wang (University of Science and Technology of China, China) LiRong Dai (University of Science and Technology of China, China) Hongjiang Zhang (Microsoft Research Asia, China)

Abstract : Conventional frame rate up-conversion adopted in low bit-rate video coding/streaming cannot obtain good quality due to artifacts caused by composition problems. In this paper, a region based multiple frame-rate tradeoff scheme is proposed to reduce artifacts. The video frames are divided into regions of interest (ROIs) and backgrounds by visual attention model. The motion intensity and complexity of ROI and background are computed by perceptive motion energy spectrum (PMES) to decide the ratio of the frame rate of ROI to that of background. The background is encoded at a low frame rate, and up-converted to the same frame rate as ROI at the decoder, with an integrated background motion composition model. The experimental results indicate that, compared to conventional frame rate up-conversion and normal codec scheme without frame rate up-conversion at the same bandwidth, the proposed scheme has higher PNSR performance and better subjective visual quality.

Menu