Super-Resolution Reconstruction for Mixed Resolution Videos Using Key Frames and Adaptive Detail Warping
In the mixed resolution coding approach, one type of scalable video coding, a mixed resolution video sequence contains low-resolution (LR) nonkey video frames at high frame rate and periodic high-resolution (HR) key video frames at low frame rate in order
- PDF / 837,571 Bytes
- 8 Pages / 439.37 x 666.142 pts Page_size
- 27 Downloads / 161 Views
Super-Resolution Reconstruction for Mixed Resolution Videos Using Key Frames and Adaptive Detail Warping Yun-Jhen Chen, Jin-Jang Leou and Han-Hui Hsiao
Abstract In the mixed resolution coding approach, one type of scalable video coding, a mixed resolution video sequence contains low-resolution (LR) nonkey video frames at high frame rate and periodic high-resolution (HR) key video frames at low frame rate in order to reduce bit rate and encoding complexity. At the decoder, LR nonkey video frames can be upsampled to the corresponding HR video frames by neighboring HR key video frames via video super-resolution. In this study, a video super-resolution reconstruction approach for mixed resolution videos using key frames and adaptive detail warping is proposed. Resolution enhancement is realized by incorporating the high-frequency details into the HR nonkey video frames that are directly upsampled by same conventional spatial interpolation method. The corresponding high-frequency details of each nonkey frame are derived by adaptive detail warping of the high-frequency details extracted from two (forward and backward) neighboring HR key frames, using the non-local-means concept and motion estimation. Based on the experimental results obtained in this study, the performance of the proposed approach is better than those of three comparison approaches.
Keywords Super-resolution reconstruction Mixed resolution video Key frames Nonkey frames Nonlocal means Adaptive detail warping
26.1 Introduction In the mixed resolution coding approach, one type of scalable video coding, a mixed resolution video sequence contains low-resolution (LR) nonkey video frames at high frame rate and periodic high-resolution (HR) key video frames at Y.-J. Chen J.-J. Leou (&) H.-H. Hsiao Department of Computer Science and Information Engineering, National Chung Cheng University, Chiayi, Taiwan 621, Republic of China e-mail: [email protected]
A. A. Farag et al. (eds.), Proceedings of the 3rd International Conference on Multimedia Technology (ICMT 2013), Lecture Notes in Electrical Engineering 278, DOI: 10.1007/978-3-642-41407-7_26, Springer-Verlag Berlin Heidelberg 2014
267
268
Y.-J. Chen et al.
low frame rate in order to reduce bit rate and encoding complexity [1]. At the decoder, LR nonkey video frames can be upsampled to the corresponding HR nonkey video frames by neighboring HR key video frames via video superresolution. At the decoder, the simple way to upsample the LR nonkey video frames to the corresponding HR video frames is spatial interpolation [2], i.e., each LR nonkey video frame is directly upsampled to the corresponding HR video frame by some spatial interpolation algorithm, such as linear interpolation, bicubic interpolation, …, without using temporal correlation information within neighboring key and nonkey frames. This type of approaches usually suffer from several types of visual degradation, such as jagging and artifacts. At the decoder, to up-sample the LR nonkey video frames to the corresponding HR
Data Loading...
