As with many car makers, Mercedes is using the Consumer Electronics Show in Las Vegas to show off its tech abilities, starting with a new AI digital assistant.
Natural responses
The new MBUX Virtual Assistant is part of the equally new MB.OS software setup, which will underpin the next generation of Mercedes cars. The Virtual Assistant will use generative artificial intelligence (the most famous form of which, currently, is ChatGPT) to power a clever new in-car voice control system which is chattier and more natural in its responses, rather than the 'Computer Says No' systems which rely on you learning specific commands.
"With our MB.OS, world-class collaborations and the latest developments in generative AI, we are transforming the relationship our customers have with their Mercedes-Benz. Our digital advances on show at CES 2024 are proof points on our journey towards the hyper-personalised Mercedes-Benz user experience," said Markus Schäfer, Mercedes' Chief Technology Officer.
Mercedes claims that the Virtual Assistant is: "the most human-like interface with a Mercedes-Benz yet. Based on MB.OS, it presents a new face to the customer with natural and empathetic interaction. With its four different emotions, the MBUX Virtual Assistant is in tune with customer needs and uses generative AI and proactive intelligence to make life easy, convenient and comfortable."
What does that mean for you? Well, according to Mercedes, the Assistant can offer helpful suggestions based on learned behaviour and the overall situation. Examples include playing the latest news in the morning or initiating a preferred seat massage programme at the end of the working day. And if you're running late for a meeting entered into the calendar, the system can offer to dial in directly from the car. If you like, these processes can also be automated. The experience can be further augmented through the use of the vehicle's ambient lighting and sound system. For example, warm light and soft music can accompany a relaxing massage if you're feeling stressed...
Personality traits
Mercedes claims that the Assistant will have four 'personality traits', which it calls Natural, Predictive, Personal and Empathetic. The idea is that the computer can replicate human-like responses so that "the effect is more like a conversation with a friend." You can ask it to open the car's windows, choose a music playlist, or even ask it general knowledge questions.
On screen, the Assistant is represented by an animated Mercedes three-pointed star. This can use different visual reactions to show whether the Assistant is speaking, listening, thinking, making a suggestion or providing a warning.
It's combined with a new MBUX Surround Navigation, which basically puts the car and what it can 'see' around itself with the camera system into the navigation. This allows it to, according to Mercedes: "Offer everything the driver needs to know in a single glance. For instance, it shows the type of traffic, be it another car, van, truck or even a cyclist. It shows pedestrians close to the roadside as well as potential hazards. And it superimposes route guidance into a realistic representation of the surroundings - particularly helpful in busy urban environments. The customer can clearly see where exactly their next turn will take them. Buildings and other infrastructure are easy and quick to recognise. The system also provides integrated oversight of the car's status, through virtual-reality real-time visualisation. This includes flashing indicators, high or low headlight beam and even acceleration or deceleration depicted by spinning wheels."
The new MB.OS system will also include a tie-up with Sony Picture's 'RIDEVU' movie and TV streaming service, and it seems that the NFTs that we all thought were dead and gone aren't quite - collectable NFTs will be part of the ownership experience.
To ensure a top-quality audio experience, Mercedes and its traditional stereo supplier, Burmester, have teamed up with Dolby, Amazon, and Audible to provide a new system that combines Dolby Atmos surround sound and connections to the Amazon Music and Audible audiobook libraries so that you can be both immersed in song or stuck into a good book, as you drive. The rollout of this setup will be available in the E-Class and CLE coupe from the end of 2024 before spreading to the rest of the Mercedes range.
Make your own in-car music
Oh, and speaking of music, there's also a new system that will allow you and your Mercedes to compose your own tunes - sort of. Mercedes has announced that it's working with music legend will.i.am to create the MBUX Sound Drive. This will use a series of sensors to turn all of the movements of the driver and the car - recuperation, acceleration, steering, and braking - and convert them into different musical sounds which, when combined, form your own sort of personal symphony.
"Imagine a world where your car can become an instrument creating musical journeys. MBUX Sound Drive enhances driving and sound technology, letting motorists reshape music just by driving. I'm excited to see how composers, producers, and songwriters will harness this to create new works and reimagine classics for motorist to drive to. MBUX Sound Drive is not only a new frontier for music creation, but also opens up fresh, exciting and interactive listening experiences for drivers," said will.i.am.
The technology connects the car hardware with the music software through precise in-car signals that enable the music to react to the driving characteristics in real time. These pre-determined parameters range from acceleration and braking to energy recuperation and steering angle. The technology is also capable of syncing with other in-car 'signals'. One example could be the windscreen rain sensors that provide soothing rhythms during inclement weather to reduce stress and enhance concentration.