Error sensitivity model based on spatial and temporal features
- PDF / 1,417,752 Bytes
- 18 Pages / 439.37 x 666.142 pts Page_size
- 67 Downloads / 198 Views
Error sensitivity model based on spatial and temporal features Ran Ma 1,2
1
1
3
& Tong Li & Dezhi Bo & Qiang Wu & Ping An
1,2
Received: 29 September 2019 / Revised: 11 July 2020 / Accepted: 21 July 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract
Packet loss and error propagation induced by it are significant causes of visual impairments in video applications. Most of the existing video quality assessment models are developed at frame or sequence level, which can not accurately describe the impact of packet loss on the local regions in one frame. In this paper, we propose an error sensitivity model to evaluate the impact of a single packet loss. We also make full use of the spatio-temporal correlation of the video and analyze a set of features that directly impact the perceptual quality of videos, based on the specific situation of video packet loss. With the aid of the support vector regression (SVR), these features are used to predict the error sensitivity of the local region. The proposed model is tested on six video sequences. Experimental results show that the proposed model predicts sensitivity of videos to different packet loss cases with certain reasonable accuracy, and provides good generalization ability, which turns out outperform the state-of-art image and video quality assessment methods. Keywords Packet loss . Spatial and temporal features . Error sensitivity . Regression
1 Introduction With the development of video applications, video has become more and more important in daily life. The demand for high quality video is still increasing, which means more capacity and bandwidth are needed. Due to the unstable bandwidth and complex transmission
* Ran Ma [email protected]
1
School of Communication and Information Engineering, Shanghai University, 99 Shangda Road, Baoshan District, Shanghai 200444, China
2
Shanghai Institute for Advanced Communication and Data Science, Shanghai University, 99 Shangda Road, Baoshan District, Shanghai 200444, China
3
Global Big Data Technologies Centre, University of Technology Sydney, NSW, Sydney 2007, Australia
Multimedia Tools and Applications
environment, packet loss often occurs in streaming video, resulting in the degradation of perceived video quality. According to the characteristics of codec system, a frame subject to packet loss may cause some impairments in the successive frames. Even in the same frame, packet loss appearing in different regions (e.g., the regions with intense or slow movement), causes the video quality degradation at different degrees [4, 33]. Therefore, how to accurately measure the influence of packet loss faces challenges. Many research works have been devoted to measure the impact of packet loss on video quality [16]. The most reliable way is to collect the judgements from many viewers, since humans are the final receivers of videos, such as the works [11, 17]. At the same time such subjective methods consume large time and human resource, which makes objective quality evaluations popular.
Data Loading...
