Fraunhofer Cingo - Mobile Surround Sound

With Fraunhofer Cingo your tablet or smartphone becomes a true surround sound theater. Plug in your earphones or use the built-in stereo speakers to watch movies in enveloping surround sound - even while you’re on the move. Not only does Cingo enable an excellent surround sound listening experience over stereo speakers or headphones, it also provides existing stereo content with a more natural and clear sound and includes loudness optimization for listening in noisy environments.

Nexus 7 and Nexus 10 use Fraunhofer Cingo for audio playback.

Extended High Efficiency AAC – The world's most powerful audio codec

Extended HE-AAC is the latest codec upgrade to the AAC audio codec family. It provides significantly improved quality at low bit-rates between 8 and 64 kbit/s and above for both music and speech. Target applications include music streaming via wireless networks and digital broadcasting systems.

At IBC, Fraunhofer displays how a typical broadcast application using Extended HE-AAC could look like by showcasing a complete digital radio encoder-/decoder-chain. With this set-up the codec’s strength becomes obvious: Whether it’s talk radio, a music program or a jingle, Extended HE-AAC enables consistent high quality at low bit-rates for all signal types.

MPEG-DASH Adaptive Streaming with HEVC & 7.1 HE-AAC Multichannel

At IBC, Fraunhofer IIS, the main developer of the leading broadcast and streaming audio codec HE-AAC and Fraunhofer HHI, the main developer of the HEVC video codec, demonstrate the world's first MPEG-DASH streaming system with 7.1 HE-AAC Multichannel Audio and HEVC Video. HE-AAC v2 is the only mandatory audio codec in the DASH-AVC/264 Implementation Guidelines developed by the DASH Industry Forum ( HEVC is MPEG’s next generation high-quality low bit rate video codec. Combining the two state-of-the-art MPEG codecs with the MPEG-DASH adaptive streaming standard allows for the most-efficient transmission of high quality content at the lowest possible data rates – solely based on international ISO standards.

HE-AAC - The native surround codec in Android

Fraunhofer IIS presents the only native surround sound codec of Android: Since Android 4.1, High-Efficiency Advanced Audio Coding (HE-AAC) multichannel is natively integrated in the world’s most popular mobile operating system. This enables playback of high-quality 5.1 surround content on Android phones and tablets connected via HDMI to a home theater system. Usage of HE-AAC is absolutely free for service providers and their player apps can make use of the Android built-in HE-AAC capabilities.

HE-AAC multichannel is part of the new Fraunhofer FDK AAC codec library for Android. This software, included in Android since version 4.1, makes Fraunhofer implementations of the MPEG audio codecs AAC, HE-AAC, HE-AACv2, and AAC-ELD available to the Android community.

Dialogue Enhancement for TV and Radio

Finding the right balance between dialogue and ambient sound is a major challenge for sound engineers in TV and radio. The award-winning technology Dialogue Enhancement allows the audience to individually change the audio balance according to their preferences. TV and radio broadcasters report that reduced speech intelligibility due to background music and sound effects as well as speech-to-music balance are common sources of complaints from their audiences. This is particularly true for those with hearing impairments or who speak a different language.

Dialogue Enhancement was selected for the NAB 2012 Technology Innovation Award.

Low Complexity codec -
Transfer of high-resolution images at limited bandwith

The Low-complexity Codec developed by the Fraunhofer-Institute for Integrated Circuits IIS allows for flexibly adapting image data streams to the available infra structure and bandwidth without compromising high resolution or dynamic range qualities. Using the low-complexity codec, high-resolution images can be compressed visually lossless, frame by frame and at compression rates from 1:2 to 1:8. This enables a transmission over standard connections and cables. The codec provides extremely low latency, high data throughput and little demand of logic components. Therefore it is possible to integrate it in already existing, programmable components or to use inexpensive components as well. The low-complexity codec is a cost-efficient alternative for image processing and transmission systems in the professional movie production business and also for multi media applications.

Contact: Fraunhofer IIS, Wolfgang Heppner

High Dynamic Range

HDR – Moving pictures at any lighting level

The Fraunhofer IIS presents a new way of HDR imaging technology, which helps to improve image recording under normal day-light conditions. The IIS method called non-regular sampling allows, thanks to specially developed algorithms, for recording with only a single shot a highly dynamic range between the brightest and the  darkest areas of the image. Great advantage of this method is that cameras with this recording technology can optimally capture scenes under challenging lighting conditions as for example extremely brightlight or deep shades. This HDR recording method provides a lot of creative headroom for post-production because the complete dynamic range of the scene can be used. At the IBC2013 Fraunhofer IIS presents also a second approach to  HDR moving picture recording. With this method, a camera array is used that enables HDR without a special sensor but by using a combination of several cameras.

Contact: Fraunhofer IIS, Frederik Zilly

Light-field Media Production System

The Fraunhofer IIS light-field recording system  currently consists of a 4x4 camera array with high-resolution HD-cameras. For postproduction the DOPs and producers can are given endless creative freedom to work with the shot material – modify the scenes by changing the camera angle like the Matrix-effect, which shows the actor like frozen in the middle of the scene and the camera moving around the object. In addition, the viewing angle can be shifted or even extended as if the camera was moved although the recording was in fact static. So, parts of the recorded scene which would be masked at a usual straight-on view can be integrated in the scene. The plus of views also allows for a virtual modification of the camera position. The object can be moved back and forth to the spectator without changing the position of the camera array during recoding – this way the cameramen are able to realize the Vertigo or Dolly-zoom effect.

Contact: Fraunhofer IIS, Dr. Joachim Keinert

Adaptive Content Streaming for TV-Live-Production

The most challenging part of recording live events is the fast and reliable image data transfer from different cameras into the broadcast truck or the broadcast control room. The huddle of special cables and transmission lines is enormous to deliver all image and audio data in time. Therefor scientists of the Fraunhofer IIS are working on a method based on scalable compression formatsllike JPEG 2000. The main goal is to replace special cables by cost-efficient standard components. The basic idea of this development is that at a certain point of time not all cameras have to transfer their image data in highresolution and highquality to the broadcast truck or video control room.

Today, every camera – even if it is not delivering the main content – continuously transfers many, high-resolution images in maximum quality over the connection line to the image control room. While using the adaptive content streaming method of the Fraunhofer IIS the image data of all used cameras are losslessly coded in the JPEG 2000 format. The center camera delivers all image data in the JPEG 2000 format, all other active cameras transfer only a preview. Thanks to the scalability of JPEG 2000 the high-resolution image data of these cameras can be stored in the camera or, when required, delivered without multiple compressing and decoding. Great advantage is the use of standard connections for the image transfer.

Contact: Fraunhofer IIS, Heiko Sparenberg

Intelligent Camera -
New Dimensions of Mobile Technology Convergence

The Intelligent Camera INCA, a development of the Fraunhofer IIS, is combining highest processing power with a compact design. Its various interfaces (HDMI, Ethernet, HD-SDI) make a maximum of different individual applications possible. INCA Eagle Cam is a specific application of the camera platform to customized requirements. For the production of a nature film, the INCA Eagle Cam was adapted to the body and the flight of an eagle.

Contact: Fraunhofer IIS. Wolfgang Thieme

ASP – Automated Stereo Production

In the ASP (Automated Stereo Production) collaborative research project – which is subsidized by the Federal Ministry of Economics and Technology – the project partners Fraunhofer HHI, Fraunhofer IIS, Zeiss, P+S Technik and KUK Film are developing a smart embedded 3D stereo camera assistance system for unattended broadcast and POV applications. The aim of the research project is reducing the cost of future 3D stereo recording without any loss of quality.

Contact: Fraunhofer IIS, Stephan Gick