Exploring interaction techniques for 360 panoramas inside a 3D reconstructed scene for mixed reality remote collaboratio
- PDF / 1,006,022 Bytes
- 13 Pages / 595.276 x 790.866 pts Page_size
- 29 Downloads / 207 Views
ORIGINAL PAPER
Exploring interaction techniques for 360 panoramas inside a 3D reconstructed scene for mixed reality remote collaboration Theophilus Teo1,2
· Mitchell Norman1 · Gun A. Lee1 · Mark Billinghurst1 · Matt Adcock2
Received: 4 February 2020 / Accepted: 14 July 2020 © Springer Nature Switzerland AG 2020
Abstract Remote collaboration using mixed reality (MR) enables two separated workers to collaborate by sharing visual cues. A local worker can share his/her environment to the remote worker for a better contextual understanding. However, prior techniques were using either 360 video sharing or a complicated 3D reconstruction configuration. This limits the interactivity and practicality of the system. In this paper we show an interactive and easy-to-configure MR remote collaboration technique enabling a local worker to easily share his/her environment by integrating 360 panorama images into a low-cost 3D reconstructed scene as photo-bubbles and projective textures. This enables the remote worker to visit past scenes on either an immersive 360 panoramic scenery, or an interactive 3D environment. We developed a prototype and conducted a user study comparing the two modes of how 360 panorama images could be used in a remote collaboration system. Results suggested that both photo-bubbles and projective textures can provide high social presence, co-presence and low cognitive load for solving tasks while each have its advantage and limitations. For example, photo-bubbles are good for a quick navigation inside the 3D environment without depth perception while projective textures are good for spatial understanding but require physical efforts. Keywords Mixed reality · Remote collaboration · 360 Panorama · 3D scene reconstruction · Interaction methods
1 Introduction Remote collaboration techniques can enable a local worker to collaborate or receive help from a remote expert from different locations. For example, video-conferencing can be used to share audio and video cues between remote workers. Mixed reality (MR) technologies, such as overlaying virtual annotations on a view of the real world [1,2] can improve collaborative performance by using natural visual cues for nonverbal communication.
B
Theophilus Teo [email protected] Mitchell Norman [email protected] Gun A. Lee [email protected] Mark Billinghurst [email protected] Matt Adcock [email protected]
1
University of South Australia, Adelaide, Australia
2
CSIRO, Canberra, Australia
Using augmented reality (AR) to enable the remote expert and local worker to share avatars [3–5] , view awareness cues [6,7], make gestures [8], and point [9] or draw on the local worker’s environment [10] makes otherwise difficult tasks easier to solve. In addition to sharing visual cues, using virtual reality (VR) to share a view of the local worker’s environment could also improve collaborative performance. A local worker can stream from a 360 camera [11] or 3D reconstruction using a depth camera [12] to share his/her environment to
Data Loading...
