Disparity-preserving image rectangularization for stereoscopic panorama

  • PDF / 5,966,931 Bytes
  • 16 Pages / 439.642 x 666.49 pts Page_size
  • 64 Downloads / 231 Views

DOWNLOAD

REPORT


Disparity-preserving image rectangularization for stereoscopic panorama I-Cheng Yeh1 · Shih-Syun Lin2 · Shuo-Tse Hung3 · Tong-Yee Lee4 Received: 10 August 2019 / Revised: 28 May 2020 / Accepted: 4 June 2020 / © Springer Science+Business Media, LLC, part of Springer Nature 2020

Abstract This study aims at generating a long strip stereoscopic panorama with a rectangular boundary from a stereoscopic video. The issues arising from this goal are how to automatically select appropriate frames to reduce geometric distortion in image stitching, how to preserve disparity under image warping, and how to generate a rectangular panoramic stereoscopic image without the loss of boundary information. To deal with these issues and to generate visually smooth stereoscopic panorama, a disparity-aware image warping is proposed. Moreover, the image warping method is performed on the irregular left and right panoramic images simultaneously with a hybrid control mesh to generate a rectangular panorama while preserving the spatial shape and disparity as much as possible. Experimental results on various stereo video contents show that the proposed method can effectively preserve both the spatial shapes and pixel disparity. Keywords Video processing · Stereoscopic panorama · Image warping · Disparity preserving  Tong-Yee Lee

[email protected] I-Cheng Yeh [email protected] Shih-Syun Lin [email protected] Shuo-Tse Hung [email protected] 1

Yuan Ze University, Taoyuan City, Taiwan

2

National Taiwan Ocean University, Keelung City, Taiwan

3

MStar Semiconductor, Inc., Hsinchu, Taiwan

4

National Cheng-Kung University, Tainan City, Taiwan

Multimedia Tools and Applications

1 Introduction With the development of digital photography and video recording, an increasing number of video clips has been produced. Using a wide-angle view to overview a large outdoor scene is a common technique in natural landscape photography. However, due to the acquisition limitation of imaging equipment, it is difficult to capture a wide-angle view in a single camera shot. Therefore, a number of researches on wide-angle view generation has been proposed. Although traditional 2D image stitching from a set of image or video frames has been extensively studied [30] and [31], the stereoscopic wide-angle view synthesis is still a challenging task. The term “panorama” originally appeared in the 18th century, used by the Irish painter Robert Barker to describe his painting shown in Fig. 1. The concept of panorama was first derived from large-scale mural and spherical dome paintings. Most painted panoramas serve to present a wide-angle, a landscape view, or a series of narrative illustrations.The existing panoramas can be classified into two categories, 360-degree panorama and rectangular panorama, based on the panorama shape, a 360-degree panorama shows a complete view of the surrounding environment, which is typically constructed from a series of input images that have been captured from a common viewpoint. Most of these panoramas are used t