Video coding with dynamic background
- PDF / 1,724,375 Bytes
- 17 Pages / 595.28 x 793.7 pts Page_size
- 104 Downloads / 218 Views
RESEARCH
Open Access
Video coding with dynamic background Manoranjan Paul1*, Weisi Lin2*, Chiew Tong Lau2 and Bu-Sung Lee2
Abstract Motion estimation (ME) and motion compensation (MC) using variable block size, sub-pixel search, and multiple reference frames (MRFs) are the major reasons for improved coding performance of the H.264 video coding standard over other contemporary coding standards. The concept of MRFs is suitable for repetitive motion, uncovered background, non-integer pixel displacement, lighting change, etc. The requirement of index codes of the reference frames, computational time in ME & MC, and memory buffer for coded frames limits the number of reference frames used in practical applications. In typical video sequences, the previous frame is used as a reference frame with 68–92% of cases. In this article, we propose a new video coding method using a reference frame [i.e., the most common frame in scene (McFIS)] generated by dynamic background modeling. McFIS is more effective in terms of rate-distortion and computational time performance compared to the MRFs techniques. It has also inherent capability of scene change detection (SCD) for adaptive group of picture (GOP) size determination. As a result, we integrate SCD (for GOP determination) with reference frame generation. The experimental results show that the proposed coding scheme outperforms the H.264 video coding with five reference frames and the two relevant state-of-the-art algorithms by 0.5–2.0 dB with less computational time. Keywords: Motion estimation, Video coding, H.264, Multiple reference frame, Scene change detection, Adaptive GOP, Uncovered background, Motion compensation
1. Introduction The H.264/AVC video coding standard improves ratedistortion performance significantly compared to its predecessors and competitors by introducing a number of innovative ideas in Intra- and Inter-frame coding [1-3]. Major performance improvement is taken place by means of motion estimation (ME) and motion compensation (MC) using variable block size, sub-pixel search, and multiple reference frames (MRFs) [3-8]. It has been demonstrated that MRFs facilitate better predictions than using just one reference frame, for video with repetitive motion, uncovered background, non-integer pixel displacement, lighting change, etc. Moreover, better errorresilient coding can be obtained using MRFs [9] where Zheng and Chau showed that referencing some macroblocks of the current frame from the furthest reference frame improves error resilience. The requirement of index codes (to identify the particular reference frame used), computational time in ME & MC (which increases almost * Correspondence: [email protected]; [email protected] 1 School of Computing and Mathematics, Charles Sturt University, Charles Sturt, Australia 2 School of Computer Engineering, Nanyang Technological University, Singapore, Singapore
linearly with the number of reference frames), and memory buffer size (to store decoded frames in both encoder and decoder) limits the number of reference fr
Data Loading...