Tracking of multiple planar projection boards for interactive mixed-reality applications
- PDF / 6,197,019 Bytes
- 31 Pages / 439.642 x 666.49 pts Page_size
- 40 Downloads / 130 Views
Tracking of multiple planar projection boards for interactive mixed-reality applications Panagiotis Koutlemanis1 · Xenophon Zabulis1
Received: 21 March 2017 / Revised: 6 September 2017 / Accepted: 13 October 2017 © Springer Science+Business Media, LLC 2017
Abstract The case of mixed-reality projector-camera systems is considered and, in particular, those which employ hand-held boards as interactive displays. This work focuses upon the accurate, robust, and timely detection and pose estimation of such boards, to achieve high-quality augmentation and interaction. The proposed approach operates a camera in the near infrared spectrum to filter out the optical projection from the sensory input. However, the monochromaticity of input restricts the use of color for the detection of boards. In this context, two methods are proposed. The first regards the pose estimation of boards which, being computationally demanding and frequently used by the system, is highly parallelized. The second uses this pose estimation method to detect and track boards, being efficient in the use of computational resources so that accurate results are provided in real-time. Accurate pose estimation facilitates touch detection upon designated areas on the boards and high-quality projection of visual content upon boards. An implementation of the proposed approach is extensively and quantitatively evaluated, as to its accuracy and efficiency. This evaluation, along with usability and pilot application investigations, indicate the suitability of the proposed approach for use in interactive, mixed-reality applications. Keywords Mixed reality · Augmented reality · Pose estimation · Detection · Tracking · Interactive system · Projector camera system
Electronic supplementary material The online version of this article (https://doi.org/10.1007/s11042-017-5313-6) contains supplementary material, which is available to authorized users. Xenophon Zabulis
[email protected] Panagiotis Koutlemanis [email protected] 1
Foundation for Research and Technology - Hellas (FORTH), Institute of Computer Science, N. Plastira 100, Vassilika Vouton, Heraklion, Crete 700 13, Greece
Multimed Tools Appl
1 Introduction A component of Mixed Reality refers to the mix, or augmentation, of visual content into the real environment. A widely used approach toward this goal is the optical projection upon surfaces. Static scenes have been augmented with visual projections [11, 13, 38, 46]. Typically, the projected content is warped according to the shape of the surface, so that it appears devoid of projective distortion upon the projection surfaces. In interactive Mixed Reality applications the projection surfaces are dynamic, i.e., handheld. They have to be continuously detected and localized, in order to warp content appropriately [9, 10, 14, 16, 20, 35, 41]. Planar rectangular surfaces are the most widely utilized surfaces, as they facilitate the user interface metaphor of conventional planar displays. This work falls in the context of tabletop, mixed-reality, interact
Data Loading...
