A frame-level MLP-based bit-rate controller for real-time video transmission using VVC standard
- PDF / 3,521,132 Bytes
- 13 Pages / 595.276 x 790.866 pts Page_size
- 45 Downloads / 169 Views
ORIGINAL RESEARCH PAPER
A frame‑level MLP‑based bit‑rate controller for real‑time video transmission using VVC standard Farhad Raufmehr1 · Mohammad Reza Salehi1,2 · Ebrahim Abiri1 Received: 30 April 2020 / Accepted: 8 September 2020 © Springer-Verlag GmbH Germany, part of Springer Nature 2020
Abstract Real-time video transmission is one of the most popular applications that are included in the versatile video coding (VVC) standard. However, real-time applications are encountered with practical limitations, including the buffer size and available bandwidth. In these applications, the buffer overflow and underflow should be strictly prevented and also the bit-rate fluctuation should be suppressed. In this paper, a video bit-rate controller is proposed that completely conforms with the constraints of real-time applications. The proposed controller is based on a multi-layer perceptron (MLP) neural network which estimates the proper quantization parameter (QP) modification at the frame level. The buffer occupancy is directly included in the QP derivation process for robust buffer control. Experimental results show that the proposed bit-rate controller fulfils the buffering constraints and controls the bit-rate accurately. The average bit-rate error of the proposed method is 0.29% while providing a low initial buffering delay of about 0.21 s. Also, the rate-distortion analysis shows that the performance of the proposed method is close to those of the conventional algorithms. Keywords Versatile video coding (VVC) · Bit-rate · Buffer · Control · Quantization parameter (QP) · Multi-layer perceptron (MLP)
1 Introduction Drastic video traffic over communication networks, besides the demand for new applications such as high dynamic range and 360° omnidirectional, raised the need for a new standardization activity [1, 2]. Accordingly, the ITU-T Video Coding Expert Group in collaboration with ISO/IEC Moving Picture Expert Group established the Joint Video Exploration Team (JVET) which is responsible for exploring new video coding tools with capabilities and coding efficiency beyond the high-efficiency video coding (H.265/HEVC) standard. The explored technologies are incorporated in the new generation of video coding standards named as versatile video coding (VVC) [3, 4]. One of the applications that are addressed in the VVC standard is real-time video transmission, such as live video * Farhad Raufmehr [email protected] 1
Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, Iran
Regional Information Center for Science and Technology, Shiraz, Iran
2
broadcasting and streaming [3]. Real-time video systems can be implemented by either parallel processor hardware devices [5, 6] or algorithms having the time-saving capability. In such applications, the bandwidth is constrained, and also the size of the transmission buffer is limited. However, the output bit-rate of the video encoder has fluctuation. Consequently, the output bit-rate of the encoder should be controlled, and
Data Loading...
