MPEG-H Audio

The MPEG-H Audio system can ingest Next Generation Audio content using the Audio Definition Model (ADM) according to ITU-R BS.2076 or the Immersive Audio Bitstream (IAB) according to SMPTE ST 2098-2. The MPEG-H ADM Profile provides native interoperability with production and distribution systems for MPEG-H Audio in real-time and post-production workflows. The Fraunhofer ADM Info Tool facilitates automated conformance testing of ADM-based content with respect to ADM profiles supported by the MPEG-H Audio system.

MPEG-H Audio powers the new music format 360 Reality Audio, initiated by Sony. This makes it possible for artists and music creators to produce an immersive musical experience by positioning sound sources such as vocals, chorus and instruments in space to perfectly match the creative and artistic intent. When playing back the resulting content, users can enjoy music that immerses them in sound from every direction as intended by the content creator.

First 360 Reality Audio immersive music streaming services from Amazon Music HD, Deezer, nugs.net and TIDAL launched in fall 2019. There are more than 2000 songs from big Labels such as Sony Music, Universal Music and Warner Music as well as live concerts offered by Live Nation. The first dedicated 360 Reality Audio playback device is the Amazon Echo Studio premium smart speaker. To play back 360 Reality Audio with headphones, those should be combined with an Android/iOS smartphone that has a participating streaming services app installed.

A prototype for immersive music playback in a car was demonstrated by Fraunhofer, Audi and Sony at the 2019 AES International Conference on Automotive Audio in September 2019. Being able to enjoy popular recording artists’ latest immersive music mixes in any environment and on many 3D audio enabled devices will provide audiences with a seamless immersive experience.

Fraunhofer IIS offers 360 Reality Audio compliant MPEG-H decoders to manufacturers of CE devices.

Fraunhofer’s interactive and immersive audio system for TV broadcasting and streaming, based on MPEG-H Audio

Hear your home team™: Interactivity offers a personalized listening experience

Our system offers interactivity using MPEG-H’s object coding, which allows viewers to adjust the sound mix to their preferences, boosting hard-to-understand dialogue or creating a “home team“-mix of sports broadcasts. This feature may also be used to efficiently add objects for dialogue in additional languages or VI descriptions to a broadcast, spending only 20-40 kbit/s for each language.

Immersive sound offers cinema-like realism

The system may transmit immersive sound with additional front and rear height speaker channels or the Higher-Order Ambisonics sound field technology, improving today’s surround sound broadcasts and streams to provide a truly realistic and immersive audio experience on par with the latest cinema sound systems.

Immersive sound may also be enjoyed with devices such as 3D soundbars, enabling mainstream consumers to experience high-quality immersive audio without the complexity of adding new speakers.

Unsurpassed coding efficiency

Since the system uses the new MPEG-H Audio codec based on the evolution of the AAC family as well as new technologies, the additional channels or objects needed for 3D sound can be transmitted at bit rates similar to those used today for 5.1 surround broadcasts.

Internet-ready for a great listening experience on every device

The MPEG-H Audio based system offers DASH support for stutter-free streaming and audio I-frames for easy DASH bit stream switching and easy splicing for ad insertion. It includes multi-platform loudness control to provide a tailored experience for a viewer’s device and listening environment.

Speaker-foolproof rendering for the best sound from legacy speakers

Improved rendering technologies in the system offer the ability to play any content format on any speaker configuration and may be able to correct for misplaced speakers in the consumer’s listening room. The renderer also offers improved downmix quality by avoiding signal cancellation and may render a limited impression of height without height speakers, for legacy 5.1 or 2.0 consumers.