Mixed Reality Interaction and Presentation Techniques for Medical Visualisations

Mixed, Augmented and Virtual reality technologies are burgeoning with new applications and use cases appearing rapidly. This chapter provides a brief overview of the fundamental display presentation methods; head-worn, hand-held and projector-based displa

  • PDF / 1,462,307 Bytes
  • 17 Pages / 504.567 x 720 pts Page_size
  • 5 Downloads / 268 Views

DOWNLOAD

REPORT


Mixed Reality Interaction and Presentation Techniques for Medical Visualisations Ross T. Smith, Thomas J. Clarke, Wolfgang Mayer, Andrew Cunningham, Brandon Matthews, and Joanne E. Zucco Abstract

Keywords

Mixed, Augmented and Virtual reality technologies are burgeoning with new applications and use cases appearing rapidly. This chapter provides a brief overview of the fundamental display presentation methods; head-­ worn, hand-held and projector-based displays. We present a summary of visualisation methods that employ these technologies in the medical domain with a diverse range of examples presented including diagnostic and exploration, intervention and clinical, interaction and gestures, and education.

Mixed reality · Augmented reality · Virtual reality · Medical visualization · Presentation techniques

R. T. Smith (*) · T. J. Clarke · A. Cunningham B. Matthews · J. E. Zucco IVE: Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, Australia Wearable Computer Laboratory, University of South Australia, Adelaide, Australia e-mail: [email protected]; thomas.clarke@ mymail.unisa.edu.au; [email protected]. au; [email protected] W. Mayer AI and Software Engineering Laboratory, University of South Australia, Adelaide, Australia e-mail: [email protected]

7.1

Introduction

Immersive technologies such as mixed and virtual reality provide a method of interacting with 3D data that is perceived differently compared to traditional desktop displays. These technologies provide spatial experiences and interactions that go well beyond those available on flat screens with mouse and keyboard interactions. Immersive technologies enable the user to freely explore virtual information by means of zooming, changing viewpoint, highlighting important aspects while hiding others, and interacting with the virtual world in ways that would be impossible to achieve in the real world. Some techniques even enable users to walk around in the virtual environment as if it were real. For example, using a mixed reality display, a virtual human can be presented in a 1:1 scale and appear to be sitting at an office desk, unlike a desktop display where the virtual human always appears inside the computer. One area these technologies have focused on is delivering immersive and interactive experiences that allow users to move freely around 3D environments to deliver compelling visualisations. There are a diverse set of visualisa-

© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2020 P. M. Rea (ed.), Biomedical Visualisation, Advances in Experimental Medicine and Biology 1260, https://doi.org/10.1007/978-3-030-47483-6_7

123

R. T. Smith et al.

124

tions that are being developed in the medical domain, from X-ray vision techniques that allow users to peek inside the human body to abstract data representations that support planning of procedures or analysis of scan data. This chapter provides an overview o