The face image super-resolution algorithm based on combined representation learning
- PDF / 3,701,345 Bytes
- 23 Pages / 439.37 x 666.142 pts Page_size
- 100 Downloads / 174 Views
The face image super-resolution algorithm based on combined representation learning Yuantao Chen 1 & Volachith Phonevilay 1 & Jiajun Tao 1 & Xi Chen 1 & Runlong Xia 2 & Qian Zhang 3 & Kai Yang 3 & Jie Xiong 4 & Jingbo Xie 2 Received: 2 February 2020 / Revised: 22 August 2020 / Accepted: 24 September 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract
Face super-resolution reconstruction is the process of predicting high-resolution face images from one or more observed low-resolution face images, which is a typical pathological problem. As a domain-specific super-resolution task, we can use facial priori knowledge to improve the effect of super-resolution. We propose a method of face image super-resolution reconstruction based on combined representation learning method, using deep residual networks and deep neural networks as generators and discriminators, respectively. First, the model uses residual learning and symmetrical cross-layer connection to extract multilevel features. Local residual mapping improves the expressive capability of the network to enhance performance, solves gradient dissipation in network training, and reduces the number of convolution cores in the model through feature reuse. The feature expression of the face image at the high-dimensional visual level is obtained. The visual feature is sent to the decoder through the cross-layer connection structure. The deconvolution layer is used to restore the spatial dimension gradually and repair the details and texture features of the face. Finally, combine the attention block and the residual block reconstruction in the deep residual network to super-resolution face images that are highly similar to high-resolution images and difficult to be discriminated by the discriminator. On this basis, combined representation learning is conducted to obtain numerous realistic results of visual perception. The experimental results on the face datasets can show that the Peak Signal-to-Noise Ratio of the proposed method is improved. Keywords Combined representation learning . Face image super-resolution . Image restoration . Attention mechanism . Deep learning
* Yuantao Chen [email protected] Extended author information available on the last page of the article
Multimedia Tools and Applications
1 Introduction In order to meet the demand of face recognition, face image super-resolution has been paid much more attention in recent years. The image captured by the monitor will be affected by the ambiguity of the atmosphere and motion transformation of the target, resulting in the low resolution of the captured face image, which cannot be recognized by human or machine. Therefore, the clarity of face images must be urgently improved. The method of enhancing the resolution of face image by using super-resolution (SR) restoration technology has become an important means for solving this problem. Face super-resolution reconstruction is the process of predicting high-resolution (HR) face images based on one or more observed low-resolu
Data Loading...
