The combination of visual communication cues in mixed reality remote collaboration
- PDF / 1,965,430 Bytes
- 15 Pages / 595.276 x 790.866 pts Page_size
- 65 Downloads / 168 Views
ORIGINAL PAPER
The combination of visual communication cues in mixed reality remote collaboration Seungwon Kim1 · Gun Lee1 · Mark Billinghurst1 · Weidong Huang2 Received: 17 February 2020 / Accepted: 17 June 2020 © Springer Nature Switzerland AG 2020
Abstract Many researchers have studied various visual communication cues (e.g. pointer, sketch, and hand gesture) in Mixed Reality remote collaboration systems for real-world tasks. However, the effect of combining them has not been so well explored. We studied the effect of these cues in four combinations: hand only, hand + pointer, hand + sketch, and hand + pointer + sketch, within the two user studies when a dependent view and independent view are supported respectively. In the first user study with the dependent view, the results showed that the hand gesture cue was the main visual communication cue and adding sketch cue to the hand gesture cue helped participants complete the task faster. In the second study with the independent view, the results showed that the hand gesture had an issue of local worker understanding remote expert’s hand gesture cue and the main visual communication cue was the pointer cue with fast completion time and high level of co-presence. Keywords Mixed reality · Remote collaboration · Communication cue · 3D scene reconstruction · Hand gesture · Sketch · pointer
1 Introduction In this paper, we explore a Mixed Reality (MR) [1] remote collaboration (the local worker collaborates in Augmented Reality (AR) environment involving a real world task space with virtual communication cues, and the remote expert collaborates in a computer-generated 3D reconstruction of the task space which is similar with Virtual Reality (VR) environment) for completing spatial physical tasks such as fixing a car, maintaining machinery, or assembling puzzles. Since the remote expert is not in the environment where the task is
B
Seungwon Kim [email protected] Gun Lee [email protected] Mark Billinghurst [email protected] Weidong Huang [email protected]
1
School of Information Technology and Mathematical Sciences, University of South Australia, Mawson Lakes Campus, Mawson Lakes, SA 5095, Australia
2
University of Technology Sydney, PO Box 1234, Broadway, NSW 2007, Australia
being performed, there should be a way to provide awareness of the task space. In previous studies, this had typically been done in two ways: using dependent and independent views. A dependent view is where a local worker controls the viewpoint and the remote expert has the same view as the local worker [2–6]. In comparison, an independent view allows the remote expert to look at the task space independently from local worker’s viewpoint [7–9]. This paper describes two user studies in dependent and independent views. Additionally, the remote expert is not in the task space, so it is necessary to virtually represent their ideas or instructions through visual communication cues [10]. The most studied visual communication cues are pointers [11–15], sketches [2,14
Data Loading...
