Virtual Reality System with Integrated Sound Field Simulation and Reproduction

  • PDF / 2,475,221 Bytes
  • 19 Pages / 600.03 x 792 pts Page_size
  • 1 Downloads / 181 Views

DOWNLOAD

REPORT


Research Article Virtual Reality System with Integrated Sound Field Simulation and Reproduction 1 Michael Vorlander, 1 and Ingo Assenmacher2 ¨ ¨ Tobias Lentz,1 Dirk Schroder, 1 Institute 2 Virtual

of Technical Acoustics, RWTH Aachen University, Neustrasse 50, 52066 Aachen, Germany Reality Group, RWTH Aachen University, Seffenter Weg 23, 52074 Aachen, Germany

Received 1 May 2006; Revised 2 January 2007; Accepted 3 January 2007 Recommended by Tapio Lokki A real-time audio rendering system is introduced which combines a full room-specific simulation, dynamic crosstalk cancellation, and multitrack binaural synthesis for virtual acoustical imaging. The system is applicable for any room shape (normal, long, flat, coupled), independent of the a priori assumption of a diffuse sound field. This provides the possibility of simulating indoor or outdoor spatially distributed, freely movable sources and a moving listener in virtual environments. In addition to that, near-tohead sources can be simulated by using measured near-field HRTFs. The reproduction component consists of a headphone-free reproduction by dynamic crosstalk cancellation. The focus of the project is mainly on the integration and interaction of all involved subsystems. It is demonstrated that the system is capable of real-time room simulation and reproduction and, thus, can be used as a reliable platform for further research on VR applications. Copyright © 2007 Tobias Lentz et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

1.

INTRODUCTION

Virtual reality (VR) is an environment generated in the computer with which the user can operate and interact in real time. One characteristic of VR is a three-dimensional and multimodal interface between a computer and a human being. In the fields of science, engineering, and entertainment, these tools are well established in several applications. Visualization in VR is usually the technology of primary interest. Acoustics in VR (auralization, sonification) is not present to same extent and is often just added as an effect and without any plausible reference to the virtual scene. The method of auralization with real-time performance can be integrated into the technology of “virtual reality.” The process of generating the cues for the respective senses (3D image, 3D audio, etc.) is called “rendering.” Apparently, simple scenes of interaction, for instance, when a person is leaving a room and closes a door, require complex models of room acoustics and sound insulation. Otherwise, it is likely that coloration, loudness, and timbre of sound within and between the rooms are not sufficiently represented. Another example is the interactive movement of a sounding object behind a barrier or inside an opening of a structure, so that the object is no longer visible but can be heard by diffraction.

1.1.

Sound field modeling

The task of producing a realistic acoustic