Virtual LiVe

The Virtual LiVe project aims to digitize physical event formats through the use of new immersive media formats (e.g. 3D audio, 360° video, light fields, volumetric video). Virtual LiVe explores how today's solutions can be extended through high-quality virtual presence with immersive content to create new formats for virtual and hybrid cultural events as well as platforms for conventions and trade shows. Fraunhofer FOKUS, Fraunhofer HHI and Fraunhofer IIS are working together to find applicable high-end solutions for the event streaming needs of various players from different industries.

The project is funded as part of the Fraunhofer-Gesellschaft's SME acute program “Research for SMEs”.

Current challenge

Due to the Corona crisis, face-to-face events such as concerts, trade fairs or workshops are no longer possible in the classical format with physical presence. This leads to cultural impoverishment and endangers business and cultural exchange in society.

Solution

Virtual LiVe will develop a toolbox with individual elements from the technological expertise of the project partners. SMEs can put together a customized program from this toolbox depending on the needs and requirements for their respective event needs and thus obtain a technology-based solution for the realization of their formats.

The aim is to develop and evolve:

Platforms and distribution: Identification, evaluation and implementation of technical and non-technical requirements and corresponding design of a platform for near-real-time and protected transmission of media content and interactions, of marketing options (pay-per-use (tickets), subscription or advertising-supported models), and of necessary changes and adaptation along the distribution chain.

360° video and 3D audio: Identification, evaluation and implementation of requirements for high-quality 360° video and 3D audio livestreaming for concerts, compatible with various end devices.

Interactive 3D content: Identification, evaluation and implementation of workflows and tools for audiovisual interaction with realistic spatial perception through the combination of representation formats (i.e. 360°-video, light-fields, or 3D-audio), data reduction for immersive interactive content, efficient use of interaction possibilities and integration into communication platforms.

Note: When playing the video, data is transferred to YouTube.