At the CES show last month, Mercedes-Benz its NVIDIA-powered MBUX infotainment system–a next-gen car cabin experience can learn and adapt to driver and passenger preferences, thanks to artificial intelligence.
According to NVIDIA, all the key MBUX systems are built together with NVIDIA, and they’re all powered by NVIDIA. The announcement comes a year after Huang joined Mercedes-Benz execs on stage at CES 2017 and said that their companies were collaborating on an AI car that would be ready in 2018.
Powered by NVIDIA graphics and deep learning technologies, the Mercedes-Benz User Experience, or MBUX, has been designed to deliver beautiful new 3D touch-screen displays. It can be controlled with a new voice-activated assistant that can be summoned with the phrase “Hey, Mercedes. It’s an intelligent learning system that adapts to the requirements of customers, remembering such details as the seat and steering wheel settings, lights and other comfort features.
The MBUX announcement highlights the importance of AI to next-generation infotainment systems inside the car, even as automakers are racing put AI to work to help vehicles navigate the world around them autonomously. The new infotainment system aims to use AI to adapt itself to drivers and passengers— automatically suggesting your favorite music for your drive home, or offering directions to a favorite restaurant at dinner time. It’s also one that will benefit from “over-the-air” updates delivering new features and capabilities.
Debuting in this month (February) in the new Mercedes-Benz A-Class, MBUX will power dramatic wide-screen displays that provide navigation, infotainment and other capabilities, touch-control buttons on the car’s steering wheel, as well as an intelligent assistant that can be summoned with a voice command. It’s an interface that can change its look to reflect the driver’s mood—whether they’re seeking serenity or excitement—and understand the way a user talks.
NVIDIA | www.nvidia.com
To address the convergence of immersive sensory experiences fueled by voice, video and audio demands, NXP Semiconductors has launched the i.MX 8M family of applications processors. The processors combine robust media capabilities on one chip. Voice commands are expected to dominate 50% of all searches in the next two years, increasingly thinner TVs are driving the popularity of sound bars for home automation, and consumers are embracing the IoT for creating more convenient richer sensory-driven experiences.
The NXP i.MX 8M processors address designers’ requirements for one platform that combines A/V and machine learning to create connected products that can be controlled via voice command. The chips provide the process technology and edge computing needs to manage and reduce the command and question response time of smart connected devices. The i.MX 8MF is suited for a wide range of residential IoT and device control applications including everything.from smart TVs, television subscription services, sound bars and other smart speakers, to streaming media players and DVR/PVR. The processor family is also ideal for managing lighting, thermostats, door locks, home security, smart sprinklers, other systems and devices for a more intuitive and responsive home environment.
NXP’s i.MX 8M family’s features that include:
- Video and audio capabilities with full 4K Ultra HD resolution, High Dynamic Range (HDR) and the highest levels of pro-audio fidelity
- Performance and versatility with up to four 1.5 GHz ARM Cortex-A53 cores, flexible memory options, and high-speed interfaces for flexible connectivity
- Advanced Human Machine Interface (HMI) featuring dual displays, vision procession unit (VPU), and an enriched user experience
- Scalability and pin-and-power compatibility
NXP Semiconductors | www.nxp.com/iMX8M
Infineon has made a strategic minority investment in XMOS Limited, a Bristol based fabless semiconductor company that provides voice processors for IoT devices. Infineon leads the recent $15 million Series-E funding round. According to Infineon, cars, homes, industrial plants and consumer devices are rapidly becoming connected to the Internet: 3 years from now, 30 billion devices will belong to the IoT. While today the interaction between humans and machines is mostly done by touch, the next evolutionary step of IoT will lead to the omni-presence of high-performance voice control. Infineon Technologies wants to further develop its capabilities to shape this market segment.
Today, voice controllers, used in voice recognition systems, struggle to differentiate between speech from a person in the room, and a synthesized source such as a radio, TV; they often identify the voice of interest based on the loudest noise. Earlier in 2017 Infineon and XMOS demonstrated an enhanced solution to overcome these issues, using intelligent human-sensing microphones and gesture recognition. The solution featured a combination of Infineon’s radar and silicon microphone sensors to detect the position and the distance of the speaker from the microphones, with XMOS far field voice processing technology used to capture speech.
Infineon Technologies | www.infineon.com
XMOS | www.xmos.com