From Multiview Image Curves to 3D Drawings

Reconstructing 3D scenes from multiple views has made impressive strides in recent years, chiefly by correlating isolated feature points, intensity patterns, or curvilinear structures. In the general setting – without controlled acquisition, abundant text

  • PDF / 9,167,453 Bytes
  • 18 Pages / 439.37 x 666.142 pts Page_size
  • 34 Downloads / 267 Views

DOWNLOAD

REPORT


2

SRI International, Providence, USA [email protected] Polytechnic Institute, State University of Rio de Janeiro, Rio de Janeiro, Brazil [email protected] 3 Shool of Engineering, Brown University, Providence, USA benjamin [email protected]

Abstract. Reconstructing 3D scenes from multiple views has made impressive strides in recent years, chiefly by correlating isolated feature points, intensity patterns, or curvilinear structures. In the general setting – without controlled acquisition, abundant texture, curves and surfaces following specific models or limiting scene complexity – most methods produce unorganized point clouds, meshes, or voxel representations, with some exceptions producing unorganized clouds of 3D curve fragments. Ideally, many applications require structured representations of curves, surfaces and their spatial relationships. This paper presents a step in this direction by formulating an approach that combines 2D image curves into a collection of 3D curves, with topological connectivity between them represented as a 3D graph. This results in a 3D drawing, which is complementary to surface representations in the same sense as a 3D scaffold complements a tent taut over it. We evaluate our results against truth on synthetic and real datasets. Keywords: Multiview stereo · 3D reconstruction · 3D curve networks · Junctions

1

Introduction

The automated 3D reconstruction of general scenes from multiple views obtained using conventional cameras, under uncontrolled acquisition, is a paramount goal of computer vision, ambitious even by modern standards. While a fully complete working system addressing all the underlying challenges is beyond current technology, significant progress has been made in the past few years using approaches that fall into three broad classes, depending on whether one focuses on correlating isolated points, surface patches, or curvilinear structures across views, as described below. A vast majority of multiview reconstruction methods rely on correlating isolated interest points across views to produce an unorganized 3D cloud of points. Electronic supplementary material The online version of this chapter (doi:10. 1007/978-3-319-46493-0 5) contains supplementary material, which is available to authorized users. c Springer International Publishing AG 2016  B. Leibe et al. (Eds.): ECCV 2016, Part IV, LNCS 9908, pp. 70–87, 2016. DOI: 10.1007/978-3-319-46493-0 5

From Multiview Image Curves to 3D Drawings

71

Fig. 1. Our approach transforms calibrated views of a scene into a “3D drawing” – a graph of 3D curves meeting at junctions. Each curve is shown in a different color. (Please zoom in to examine closely. The 3D model is available as supplementary data.) (Color figure online)

The interest-point-based approach has been highly successful in reconstructing large-scale scenes with texture-rich images, in systems such as in Phototourism and recent large-scale 3D reconstruction work [6,15,34,47]. Despite their manifest usefulness, these methods generally cannot represent smooth, text