Real-time video freezing detection for 4K UHD videos
- PDF / 1,500,210 Bytes
- 15 Pages / 595.276 x 790.866 pts Page_size
- 17 Downloads / 224 Views
ORIGINAL RESEARCH PAPER
Real‑time video freezing detection for 4K UHD videos Ratko Grbić1 · Dejan Stefanović2 · Mario Vranješ1 · Marijan Herceg1 Received: 5 September 2018 / Accepted: 12 April 2019 © Springer-Verlag GmbH Germany, part of Springer Nature 2019
Abstract Video frame freezing is a common artifact which can occur during video content delivery due to errors in the video coding process, video transmission, storage or reproduction. This artifact can significantly decrease the end-user Quality of Experience. Therefore, accurate video frame freezing detection is of great importance for different parties involved in video content delivery. In this paper, a new Real-Time no-reference Freezing Detection Algorithm, called the RTFDA, is proposed. As newly video frames are acquired, the RTFDA performs comparison of the current video frame with the corresponding previous one to detect whether video freezing is occurring. The comparison is made by calculating the corresponding subsampled video frames and their pixel-by-pixel absolute difference comparison. The benefit of such approach is twofold: the influence of noise in freezing frames on frame comparison is significantly reduced as well as computational complexity of frame comparison. The RTFDA has a high detection rate with a very low rate of both false-positive and false-negative detections, outperforming four freezing detection algorithms on four different video databases. The proposed implementation on an x86-64 platform achieves real-time performance on 4K Ultra High Definition (UHD) videos by processing 216 frames per second (fps). Apart from that, FPGA implementation is proposed, which has efficient FPGA resource utilization. Keywords No-reference · 4K UHD · Video freezing detection · Real-time · FPGA
1 Introduction The usage of multimedia content has increased drastically in recent years. This is especially pronounced in the field of video content consuming, where the number of multimedia devices, such as smartphones, tablets, smart TVs and streaming boxes, is rapidly increasing. According to [9], IP video traffic will be 82% of all consumer internet traffic by 2021, with 26% corresponding to internet video-to-TV traffic. In such scenario, it is obvious that great importance will be placed on evaluation and maintenance of the satisfying Quality of Service (QoS) as well as the Quality of Experience (QoE) of end users. Ultra High Definition (UHD) is a relatively new TV standard aiming to slowly replace the Full HD (FHD) standard. According to the ITU-R Recommendation BT.2020 * Ratko Grbić [email protected] 1
Faculty of Electrical Engineering, Computer Science and Information Technology Osijek, Osijek, Croatia
RT-RK Institute for Computer Based Systems, Narodnog fronta 23a, Novi Sad, Serbia
2
(Rec. 2020) [13], the minimal resolution of 4K UHD content is 3840 × 2160 pixels, thus bringing a significant increase with respect to FHD resolution of 1920 × 1080 pixels. In addition to a fourfold increase in the number of pixels, with 4K UHD color cov
Data Loading...
