Fraunhofer upHear Voice Quality Enhancement

The Fraunhofer upHear Voice Quality Enhancement (VQE) technology is now available for the NXP i.MX8 platforms. The fully integrated technology processes microphone signals to enable far-field full-duplex conversations in the full perceptible audio bandwidth for conferencing solutions with consistently outstanding audio quality, as well as natural language understanding in smart assistant devices. Already in use in multiple devices on the market, the technology allows comprehension of far-field voice commands and enables barge-in by removing interfering sounds captured by the device’s microphones, extracting the user’s voice, and canceling out acoustic echoes that would otherwise prevent the Human-Machine Interface (HMI) from understanding the user’s request. This is achieved by optimally combining advanced multi‑channel acoustic echo cancellation, source localization, noise reduction, dereverberation, automatic gain control, and beamforming methods.

upHear VQE’s flexibility means it can be applied with a wide range of smart assistant devices, such as smart speakers, soundbars, cameras, TVs, and industrial devices. It offers flexibility in both the microphone and loudspeaker configuration of the device, ensuring optimal performance regardless of whether mono, stereo, surround, or immersive sound is being played back. This allows for flexible product design while ensuring optimal performance.

Technical Details

  • Processing modes
    • Automatic Speech Recognition mode for Human-Machine Interfaces, i.e., smart assistants
    • Full-Duplex Communication mode for teleconferencing applications
  • Mono output
  • Supported microphone setups
    • 1 microphone
    • Uniform linear arrays (uniformly spaced microphones in a linear configuration):
      • 2 microphones
      • the microphone spacing is a user-defined parameter
    • Uniform circular arrays (uniformly spaced microphones in a circular configuration):
      • 6 microphones in a circle
      • 3 microphones in a circle plus an additional center microphone
      • the circle radius is a user-defined parameter
  • Supported number of loudspeaker (reference) channels
    • 1 channel (mono)
    • 2 channels (stereo)
  • Supports different frame sizes
  • Supports 16kHz sampling frequency

Terms and Conditions

1. Description

upHear Voice Quality Enhancement (VQE) is a software application developed by Fraunhofer IIS. The version provided here is intended solely for evaluation purposes ("software"). For information regarding a license for commercial use, please contact Fraunhofer. The evaluation software has been validated and tested on the NXP i.MX8 platforms, and its use is exclusively restricted to these platforms.

The software comprises multiple technical security measures, including:

  • Intermittent beep emitted every 10 minutes
  • Library outputs silenced after 30 minutes
  • Library expiry date based on system time check

2. User qualification

Fraunhofer reserves the right to deliver the software at its sole discretion to qualifying users only and to deny access to the software without further explication to users that are not deemed to be qualified. Qualification is dependent on professional use of the user and shall be in conformity with German, EU, US or other applicable export control laws and regulations. In order to be approved, users must submit the information requested below.

3. Software license type

The software is intended solely for internal evaluation, and may only be used for a limited period set out in the Non-Commercial Evaluation License Agreement.

Registration

The following information is required to verify whether you qualify to download VQE.
All fields marked with * are mandatory.

Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.

(incl. house number)

(incl. house number)

Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.

(e.g. Manufacturer, System integrator, ODM, etc.)

(e.g. Manufacturer, System integrator, ODM, etc.)

Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.
Bitte füllen Sie das Pflichtfeld aus.


By registering, you consent to us storing and using your personal data and sending you regular information (by e-mail, newsletter, or direct mail) about the research and services offered by Fraunhofer IIS. We will treat your data confidentially and will not pass it on to third parties.

Your consent is voluntary and can be revoked at any time by sending an e-mail to audio-info@iis.fraunhofer.de. After confirming your registration for the VQE download, you will receive another e-mail confirming your registration for the Fraunhofer IIS Info Service.


By registering, you consent to us storing and using your personal data and sending you regular information (by e-mail, newsletter, or direct mail) about the research and services offered by Fraunhofer IIS. We will treat your data confidentially and will not pass it on to third parties.

Your consent is voluntary and can be revoked at any time by sending an e-mail to audio-info@iis.fraunhofer.de. After confirming your registration for the VQE download, you will receive another e-mail confirming your registration for the Fraunhofer IIS Info Service.

Please check the mandatory Checkbox.


Please read our Terms and Conditions and the Non-Commercial Evaluation License Agreement. By checking the box, you indicate your acceptance of all the terms and of said agreement. The Non-Commercial Evaluation License Agreement is executed and comes into force and effect when you click on the “Request Download Link” button below.


Please read our Terms and Conditions and the Non-Commercial Evaluation License Agreement. By checking the box, you indicate your acceptance of all the terms and of said agreement. The Non-Commercial Evaluation License Agreement is executed and comes into force and effect when you click on the "Request Download Link" button below.

More Information