MPEG-H Audio

Overview

© Photo Fraunhofer IIS/Viaframe
© Photo Fraunhofer IIS/Viaframe

Providing interactive, immersive sound for TV and VR applications

 

Immersive and personalized audio

Hear your home team™: The MPEG-H Audio system delivers enveloping immersive sound and allows consumers to choose between different audio presets or to adjust the dialogue volume.

 

Universal Delivery

Regardless of the device, the MPEG-H Audio system delivers the best sound experience possible  - in the home theatre as well as on smartphones, tablets and Virtual Reality devices.

 

A single technology for all applications

The MPEG-H Audio system is designed to work in streaming systems as well as in existing and future broadcast systems from contribution to emission.

 

Next-generation open audio standard

Fair pricing and an extensive community of open standards developers ensures easy and transparent access and a quick development of a whole ecosystem of devices for professionals as well as for consumers.

 

Ease of use

The MPEG-H Audio system is designed to work with today's streaming and broadcast equipment. The immersive sound features can be played back over any loudspeaker configuration or over headphones.

TV Audio

Fraunhofer’s Interactive and Immersive Audio System for TV Broadcasting Based on MPEG-H Audio

 

Hear your home team™: Interactivity offers a personalized listening experience

Our system will offer interactivity using MPEG-H’s object coding, which allows viewers to adjust the sound mix to their preferences, boosting hard-to-understand dialogue or creating a “home team“-mix of sports broadcasts. This feature may also be used to efficiently add objects for dialogue in additional languages or VI descriptions to a broadcast, spending only 20-40 kbit/s for each language.

 

Immersive sound offers cinema-like realism

The system may transmit immersive sound with additional front and rear height speaker channels or the Higher-Order Ambisonics sound field technology, improving today’s surround sound broadcasts to provide a truly realistic and immersive audio experience on par with the latest cinema sound systems.

Immersive sound may also be enjoyed in the future with devices such as Fraunhofer’s conceptual prototype of a “3D sound bar”, enabling mainstream consumers to experience high-quality immersive audio without the complexity of adding new speakers.

 

Unsurpassed coding efficiency

Since the system uses the new MPEG-H Audio codec based on the evolution of the AAC family as well as new technologies, the additional channels or objects needed for 3D sound can be transmitted at bitrates similar to those used today for 5.1 surround broadcasts.

Bit rates in kbit/s for

Good

Recommended

Transparent

22.2 Channels

256

512

1200

7.1 + 4 Height Channels

+ 4 Objects

200

384

800

5.1 Channels

96

160

256

2.0 Channels

32

56

160

 

 

Internet-ready for a great listening experience on every device

The MPEG-H Audio based system offers DASH support for stutter-free streaming and audio I-frames for easy DASH bit stream switching and easy splicing for ad insertion. It includes multi-platform loudness control to provide a tailored experience for a viewer’s device and listening environment.

 

Speaker-foolproof rendering for the best sound from legacy speakers

Improved rendering technologies in the system offer the ability to play any content format on any speaker configuration and may be able to correct for misplaced speakers in the consumer’s listening room. The renderer also offers improved downmix quality by avoiding signal cancellation and may render a limited impression of height without height speakers, for legacy 5.1 or 2.0 consumers.

The AAC family: 15 Years of proven service, providing half the world’s TV surround sound

Fraunhofer’s new TV audio system builds upon fifteen years of experience providing surround sound using the AAC codec family around the world. Fraunhofer designed the first AAC encoding hardware for Japanese HDTV in 1998 and AAC 5.1 decoding is supported in all Japanese TVs, AVRs, and soundbars. AAC is also the current codec of NHK’s new 22.2 channel audio system for Super Hi-Vision broadcasting.

This work in Japan led to the adoption of HE-AAC Multichannel as the surround codec of the ISDB-based SBTVD system used in many South American countries, and today Brazilian broadcasters, including TV Globo, use HE-AAC to provide 5.1 surround sound to their viewers.

HE-AAC is also used for surround sound in many countries using the DVB system and the AAC family has been on the air since 2009 providing surround sound for the BBC’s HD service in the UK.

Virtual Reality

MPEG-H Audio, the next-generation audio standard for TV and VR, was developed for a listening experience going beyond surround sound. Immersive 3D sound for VR is achieved by adding height information to the sound mix. Thanks to the efficiency of the new codec, 3D audio can be delivered at bitrates as low as 200 kbit/s which makes MPEG-H Audio the audio codec of choice for VR streaming services.

MPEG-H Audio can carry audio channels, audio objects and ambisonics audio plus metadata within a single audio bitstream. Audio channels provide a great way to deliver immersive audio while dynamic audio objects enable directors to use audio cues to guide the audience through 360 stories. In this context, they also allow for a very precise placement of sound events around the listener’s head and at a specific distance from the ear. Ambisonics audio on the other hand provides a convenient way to capture immersive audio scenes, for instance on set, plus they make it easier to realize point of view manipulation and head rotation at playback.

In tandem with the delivery of immersive sound to VR devices using MPEG-H Audio, Fraunhofer Cingo can be used for the authentic and realistic reproduction of the 3D sound scene over headphones. Cingo supports rendering of fully immersive 3D audio content with formats that add a height dimension – including 5.1+2 height speakers, 7.1+4 height and similar channel configurations – and allows the simultaneous placement of sound objects anywhere in the virtual space around the listener.

Fraunhofer Cingo experience
© Photo Fraunhofer IIS/David Hartfiel

Papers

Development of the MPEG-H TV Audio System for ATSC 3.0

Bleidt et al, 2017 (Written for March 2017 issue of IEEE Transactions on Broadcasting)

Building The World’s Most Complex TV Network (A Test Bed for Broadcasting Immersive and Interactive Audio)

Robert Bleidt, Herbert Thoma, Wolfgang Fiesel, Stefan Kraegeloh, Harald Fuchs, Rinat Zeh, Jim De Fillippis, S. Merrill Weiss - SMTPE Annual Technical Conference, October 2016 (Written for SMPTE Journal©)

Technical Paper: Delivering a complete suite of solutions for the next generation of virtual reality audio

2016

Technical Brief: Installing the MPEG-H Audio Alliance’s New Interactive and Immersive TV Audio System in Professional Production and Distribution Facilities

Robert Bleidt - 2015

MPEG-H 3D Audio - The New Standard for Coding of Immersive Spatial Audio

J. Herre, J. Hilpert, A. Kuntz, and J. Plogsties - IEEE Journal of Selected Topics in Signal Processing (July 2015)

Using Audio Objects and Spatial Audio in Sports Broadcasting

Ulli Scuda, Hanne Stenzel, Dennis Baxter - AES 57th International Conference, March 2015

Design, Coding and Processing of Metadata for Object-Based Interactive Audio

Simone Füg, Andreas Holzer, Christian Borss, Christian Ertel, Michael Kratschmer, Jan Plogsties - AES 137th Convention, October 2014

MPEG-H Audio - The New Standard for Universal Spatial / 3D Audio Coding

Jürgen Herre, Johannes Hilpert, Achim Kuntz, Jan Plogsties - AES 137th Convention, October 2014

Immersive Audio with MPEG 3D Audio - Status and Outlook

Robert Bleidt, Stefan Meltzer, Max Neuendorf, Jan Plogsties - NAB 2014 (Printed in the NAB Broadcast Engineering Conference Proceedings 2014, presented at the 2014 NAB Show.)

Object-Based Audio: Opportunities for Improved Listening Experience and Increased Listener Involvement

Robert Bleidt, Arne Borsum, Harald Fuchs, S. Merrill Weiss - SMPTE 2014 (Written for SMPTE Journal©)

Presentations

Introducing the MPEG-H Audio Alliance's New Interactive and Immersive TV Audio System

Robert Bleidt - HPA Tech Retreat, Palm Springs, February 2015

Starting Production in Interactive and Immersive Sound

Robert Bleidt and Dennis Baxter - Sports Video Group, New York, December 2014

Object-Based Audio: Opportunities for Improved Listening Experience and Increased Listener Involvement

Robert Bleidt - SMTPE Annual Technical Conference, October 2014

Introducing the MPEG-H Audio Alliance's New Interactive and Immersive TV Audio System

Robert Bleidt - AES 137th Convention, October 2014

Immersive Audio with MPEG-H 3D Audio: Status and Outlook

Max Neuendorf, Jan Plogsties, Stefan Meltzer, Robert Bleidt - NAB Convention, April 2014

Case Study: Field Test of Interactive 3D Audio at Winter Sports Broadcast

Hanne Stenzel, Robert Bleidt, Valentin Schilling - DTV Audio / SportsVideo Group Meeting, Las Vegas, April 2014

Fraunhofer's Interactive 3D Audio System for Television Broadcasting – What's New

Robert Bleidt - NAB Convention, April 2014

Videos

Please note: Starting the videos transfers usage data to Youtube.

Fraunhofer IIS Audio and Media Technologies at NAB Show 2017  

Robert Bleidt, General Manager Audio and Media Technologies at Fraunhofer USA DMT, presents some of the features the MPEG-H TV Audio System offers.

Audio & Media Technologies at IBC2016

We always look forward to coming to Amsterdam for the IBC exhibition: It’s the perfect place to meet up with professionals of multimedia content creation and distribution, and to present our latest Audio & Multimedia technologies.

MPEG-H Audio is one of these technologies – tune in to learn more about the immersive, interactive audio system and our other exhibits for digital radio, streaming, TV broadcast or Virtual Reality, and see how they all can form the future.

MPEG-H Audio for Next-Generation TV Broadcasting at IBC 2015

MPEG-H Audio Alliance Live Broadcast Demonstration at NAB 2015

Jünger Audio, Fraunhofer & MPEG-H

News

Request licensing information: MPEG-H Audio

To request a price quote or an evaluation license, please fill in and submit the form.

* Required

Which kind of license are you interested in?
Software platform:
Hardware platform
Title
Name