Creating the experience of "being there" - Audio technologies for VR

The boundless world of virtual reality: Holodeck 4.0

Light field for VR applications

VR technologies by Fraunhofer IIS

With its numerous research areas Fraunhofer IIS is able to offer technologies and services to a broad field of markets. One of these markets is the fascinating, still evolving world of Virtual Reality.

Virtual worlds created by Holodeck 4.0

The Holodeck 4.0 offers a variety of virtual worlds which are based on highly precise positioning technology and are created with the help of the Unity 3D Gaming Engine. Up to 40.000 square meters of virtual space are available to be explored for the most diverse scenarios, including the application areas production and logistics, architecture, gaming as well as safety and security.
Holodeck 4.0 users can move about freely. The system supports up to 100 transmitters, allowing multiple users to interact with each other and simultaneously discover the different virtual worlds.

Delivering authentic audio for a convincing VR experience

For VR to be a success, the user must feel that he is an active part of the entertainment experience instead of just a passive viewer. Of course, perfect images are part of the equation to a convincing VR experience. But another central ingredient is authentic sound which is realized by surround and even more so by three dimensional (3D) audio.
It is the objective of Audio and Media Technologies to create a truly realistic audio presence in virtual reality. The audio solutions developed by the division’s engineers and researchers offer support at every point of the production chain: Be it at the beginning where an intelligent microphone-processing algorithm helps to capture 3D sound, or at the end when consumers enjoy their virtual world with Fraunhofer Cingo enabling the playback of surround and 3D sound over headphones.

Light field for VR Applications

Moving around in VR worlds has so far only been possible in computer-generated environments. 360 degree panoramas captured from real scenes limit the viewpoint to a fixed position. Light field capturing and processing enable the user to change the perspective and viewpoint so that images from real environments can be used similar to computer generated scenes. The research area Imaging Systems at Fraunhofer IIS provides software for light field computation that extends the usage of VR to real scenes.

Positioning

We develop customized positioning and navigation solutions. Relying on more than ten different positioning and navigation technologies, our specialists adapt, further develop and combine tailored prototypes and systems to arrive at a solution that best fits the needs of our partners and customers. Possible solutions include the use of wireless sensor networks, adaptive antennas, satellite navigation, and seamless location services.

 

Audio and Media Technologies

For more than 25 years, digital audio technology has been the principal focus of the research area Audio and Media Technologies. From the creation of mp3 and the co-development of AAC to the future of audio entertainment for broadcast, Fraunhofer IIS brings innovations in sound to reality.
 

 

Imaging Systems

Through our research in the field of Imaging Systems, we help to create innovative solutions for professional camera systems, digital cinema, and smart image processing and analysis. Other focal areas of our research include light field technology, contributing to the development of coding techniques and standards, and new postproduction and multiview calibration systems.