Fast image blending for high-quality panoramic images on mobile phones

  • PDF / 7,202,104 Bytes
  • 18 Pages / 439.642 x 666.49 pts Page_size
  • 99 Downloads / 164 Views

DOWNLOAD

REPORT


Fast image blending for high-quality panoramic images on mobile phones Yili Zhao1 Received: 3 November 2019 / Revised: 13 June 2020 / Accepted: 25 August 2020 / © Springer Science+Business Media, LLC, part of Springer Nature 2020

Abstract This paper presents a fast image blending approach for combining a set of registered images into a composite mosaic with no visible seams and minimal texture distortion on mobile phones. A unique seam image is generated using two-pass nearest distance transform, which is independent on the order of input images and has good scalability. Each individual mask can be extracted from this seam image quickly. To promote blending speed and reduce memory usage in building high resolution image mosaics on mobile phones, the seam image and mask images are compressed using run-length encoding, and all the following mask operations are built on run-length encoding scheme. Moreover, single instruction multiple data instruction set is used in Gaussian and Laplacian pyramids construction to improve the blending speed further. The use of run-length encoding for masks processing leads to reduced memory requirements and a compact storage of the mask data, and the use of single instruction multiple data instruction set achieves better parallelism and faster execution speed on mobile phones. Keywords Image mosaic · Seam processing · Multi-band blending · Run-length encoding · Single instruction multiple data

1 Introduction Modern mobile phones have become computational devices equipped with high-resolution cemeras, high-quality color displays, and powerful multi-core processors, which makes it possible to develop applications for mobile computational photography and augmented reality, like panoramic image stitching [29], image inpainting [20], and image superresolution [30]. Among them mobile panoramic image allows the user to create immersive scene navigation on mobile phones and share them right away. However, compared to desktop computers, mobile phones still have some limitations, including limited amount of memory and computational power.  Yili Zhao

[email protected] 1

School of Big Data and Intelligent Engineering, Southwest Forestry University, Kunming, Yunnan 650224, China

Multimedia Tools and Applications

Image blending is the final and often very important step in many image and video composition applications, like producing high quality panoramas [15], image cloning [4], content-aware image resizing [9], texture synthesis [14] and seamless video composition [28]. Radiometric variations in overlapping views and violation of certain scene assumptions commonly lead to geometric misalignments and photometric differences. Without blending, these usually result in degrading artifacts, such as blurry regions or artificial seams. Traditional image blending methods are mainly designed for desktop copmuters and processors. With the development of mobile phone hardware, for example, nowadays a typical mobile phone’s camera will have ten million pixels at least. Such high resolution and limit