Jacob K. Javits Convention Center, 655 W 34th St, New York, NY 10001 / October 18, 2017 - October 21, 2017
AES NEW YORK 2017
143rd International Convention
143rd International Convention
MPEG-H 3D Audio is the first next generation audio system to be used in terrestrial 4K TV: Since May 2017, the new UHD TV system in South Korea is on-air utilizing the MPEG-H TV Audio System. Next year, viewers in Korea will enjoy the benefits of the new audio codec during the TV broadcast of the Olympic Winter Games. Viewers can set the audio mix for a program to their individual preferences, for example:
The immersive 3D sound of MPEG-H 3D Audio also provides a truly realistic sound experience.
For professional users, Fraunhofer IIS will present tools to produce 3D sound with MPEG-H like the plugin for the Spatial Audio Designer (SAD) and DSpatial. In addition, we will show the new Linear Acoustic AMS(TM) Authoring and Monitoring System and the Jünger Multichannel Monitoring and Authoring unit, comprehensive solutions for real-time authoring, rendering and monitoring of immersive audio programs that support MPEG-H 3D Audio.
The MPEG-H TV Audio System is designed to work with today`s broadcast and streaming equipment. The MPEG-H TV Audio System is part of the ATSC 3.0 standard and the DVB A/V codec specification.
At AES, Fraunhofer IIS will showcase an end-to-end VR audio system based on MPEG-H for production, delivery, playback and rendering of immersive sound. The entire chain consists of Fraunhofer upHear® Spatial Audio Microphone Processing, Cingo Composer post-production plugin, the MPEG-H 3D Audio codec and a VR player SDK for high-quality VR experiences.
Capture spatial audio for Virtual Reality. Fraunhofer upHear has been designed to significantly improve the sound capture capabilities of professional and consumer 360° cameras and mobile devices using built-in microphones. It automatically transforms the captured sound in real-time to any popular surround or immersive audio reproduction format, such as FOA, HOA, 5.1 channels, and 7.1+4 height channels, while preserving the authenticity of the audio scene. Spatial Audio Microphone Processing is the first audio technology to be delivered under Fraunhofer’s upHear brand of immersive audio innovations.
Looking for a tool that simplifies mixing immersive sound for VR? If so, be sure to check out the Cingo Composer plugin at AES! We recently released a BETA version of the plugin that allows sound designers to easily mix, pan and monitor audio channels, ambisonics audio, as well as audio objects using Fraunhofer Cingo. The plugin supports export of MPEG-H ready audio essence and metadata, plus export of FOA and 5.1 for legacy platforms. Therefore, you only need to mix once for any distribution channel.
The next-generation audio codec enables interactive and immersive audio experiences for VR as it can carry audio channels, ambisonics audio, as well as audio objects with metadata. Fraunhofer’s implementation allows the transmission of 3D sound on mobile devices at the same bit rates used today for the playback of 2D surround sound.
In addition to the efficient delivery of immersive sound using MPEG-H, Fraunhofer Cingo optimizes the 3D audio rendering on VR devices and applications with a stunning level of immersion, creating the experience of “being there”. Cingo’s reference customers include Samsung who integrated Cingo into the first generation of the »Gear VR«, LG for its »LG 360 VR« glasses as well as Hulu who integrated Cingo in its app for mobile and tethered VR experiences.
Besides immersive sound, Cingo enables excellent surround sound over stereo speakers and headphones when playing any media content on mobile devices such as tablets or smartphones. Thanks to loudness optimization, Cingo also improves the intelligibility of dialog and commentary making clear, authentic sound possible even in noisy environments. Cingo has been utilized in devices worldwide - for example in the Google Nexus and Pixel family of devices.
For effortless integration on VR playback systems, Fraunhofer IIS provides a VR Audio SDK, ready to create a VR experience with MPEG-H 3D Audio decoding and the best-in-class audio rendering.