NESC - Ultra Efficient AI-based Voice Codec

Built-in satellite connectivity will soon become a standard feature of phones, cars and other connected devices, leveraging GEO, LEO and multi-orbit constellations to ensure global coverage. The primary drivers for its adoption are emergency response and voice services.

Mobile and satellite network operators, device manufacturers, and regulatory bodies are keen to make universal coverage a worldwide standard by efficiently integrating terrestrial and non-terrestrial networks (NTN).

While current speech codecs work well for terrestrial 4G/5G voice services, they typically require 13 kbit/s or more to achieve good audio quality – a fact which makes them ill-suited or impractical for large-scale applications such as NTN. Fraunhofer has applied innovative AI-based technology to a new generation of voice codecs, Fraunhofer NESC, which reduces the required bitrates to some 1 kbit/s or less.

NESC Key Visual - satellite connectivity
© alones – stock.adobe.com
NESC graphic satellite connectivity
© Fraunhofer IIS

Satellite and mobile operators may soon begin to offer reliable NTN audio messaging and voice services at a large scale with Fraunhofer NESC and audio quality as good as or even better than terrestrial calls.

Fraunhofer IIS is in a unique position to serve the satellite industry thanks to its decades-long experience and offerings for satellite communications systems as well as its extensive expertise in the development of several generations of successful audio and speech codecs from mp3 to EVS, the mandatory 5G voice codec, and now the ultra-efficient AI-based Fraunhofer NESC voice codec.

Typical Application Scenarios

Emergency Response

Accidents in areas with weak or non-existent terrestrial coverage can become quite dangerous. Adding satellite connectivity and the ability to call emergency services like eCalls for help in any location saves lives. The clearer the voice can be delivered through Fraunhofer NESC, the more likely it is that essential information gets transmitted correctly.

Voice Messaging & Push-to-Talk

The ability to deliver voice notes and messages is a standard feature in today’s terrestrial services. While text messages over satellite are already being deployed on some smart phones, audio messages remain a challenge. As users expect the same functionality from NTN services in good quality and without major delays, Fraunhofer NESC helps to deliver exactly that.

Voice Calls

Fraunhofer NESC enables voice calls at scale with audio quality as good or better than terrestrial voice calls no matter if the transmission is being made through a GEO, LEO or multi-orbit constellation. Even under the most constrained network conditions, the coding efficiency, error robustness and low latency algorithm behind Fraunhofer NESC makes this reliably possible.