Connecting and Controlling Appliances Through Wearable Augmented Reality

  • PDF / 1,483,320 Bytes
  • 16 Pages / 595.276 x 790.866 pts Page_size
  • 61 Downloads / 203 Views

DOWNLOAD

REPORT


(0123456789().,-volV)(0123456789().,-volV)

ORIGINAL PAPER

Connecting and Controlling Appliances Through Wearable Augmented Reality Vincent Becker1



Felix Rauchenstein1 • Ga´bor So¨ro¨s1

Received: 5 June 2019 / Revised: 5 June 2019 / Accepted: 20 June 2019 Ó Springer Nature Singapore Pte Ltd. 2019

Abstract The number of interconnected devices around us is constantly growing, and it may become challenging for users to control all these devices when control interfaces are distributed over mechanical elements, apps, and configuration webpages. If devices are even supposed to be connected and work together, this challenge is intensified. An alternative way for configuring and controlling devices in situ is enabled by wearable technologies. In this paper, we investigate interaction methods for smart appliances in augmented reality from an egocentric perspective. We examine how users can control appliances through augmented reality directly. The physical objects are augmented with interaction widgets, which are generated on demand and represent the connected devices along with their adjustable parameters. For example, a widget can be overlaid on a loudspeaker to control its volume. We explore three ways of manipulating the virtual widgets: (1) inair finger pinching and sliding, (2) whole-arm gestures rotating and waving, (3) incorporating physical objects in the surrounding and mapping their movements to the interaction primitives. We compare these methods in a user study with 25 participants and find significant differences in the preference of the users, the speed of executing commands, and the granularity of the type of control. While these methods only apply to controlling a single device at a time, in a second part, we create a method to also take potential connections between devices into account. Users can view and configure connections between smart devices in augmented reality and furthermore can manipulate them or create new device connections using simple gestures. This facilitates the understanding of existing connections and their modification. Keywords Tangible user interfaces  Augmented reality  Ubiquitous computing  Smart objects  Wearable computing

Introduction New ways of interaction between humans and appliances have gained significant interest with the emergence of networked smart appliances. Since the times, appliances could be operated only by hard-wired knobs and buttons, we have witnessed the inventions of a number of convenience features. Remote controls were introduced in the 1950s, allowing to comfortably control a single appliance & Vincent Becker [email protected] Felix Rauchenstein [email protected] Ga´bor So¨ro¨s [email protected] 1

from a distance, and since then we reached the point that home systems allow almost universal device control via smartphone apps or even via speech and gesture recognition systems. This process can be described by the term user interface externalization. The physical user interface of an appliance is externalized from the appliance to th