Mercedes-AMG and will.i.am launch immersive MBUX SOUND DRIVE experience at CES 2024

MERCEDES-BENZ CANADA - Mercedes-AMG has announced the launch of its latest state-of-the-art technology, MBUX SOUND DRIVE – an industry-first partnership with creative artist, innovator and entrepreneur will.i.am, that delivers a ground-breaking interactive music experience. The technology uses software that allows music to react to the way the car is being driven, creating a harmonious relationship between motion and melody. This turns the car into a virtual musical instrument, transforming an already exceptional Mercedes-AMG driving experience into an emotional, musical journey.

Utilizing a suite of sensors and advanced software, MBUX SOUND DRIVE interprets various driving dynamics - such as recuperation, acceleration, steering, and braking - and converts them into musical expressions, allowing the driver to 'compose' in real-time.

“At Mercedes-Benz, we want digital innovation to bring a smile to our customers’ faces through exciting new features that make a real difference to every journey. With MBUX SOUND DRIVE, AMG drivers are in control of the way their music sounds. It makes in-car entertainment much more immersive.”
Markus Schäfer, Member of the Board of Management of Mercedes-Benz Group AG, Chief Technology Officer

“Imagine a world where your car can become an instrument creating musical journeys. MBUX SOUND DRIVE enhances driving and sound technology, letting motorists reshape music just by driving. I'm excited to see how composers, producers, and songwriters will harness this to create new works and reimagine classics for motorist to drive to. MBUX SOUND DRIVE is not only a new frontier for music creation, but also opens up fresh, exciting and interactive listening experiences for drivers.”
will.i.am, Creative Artist, Innovator and Entrepreneur

From the studio to the streets – a unique sound experience on the road

The creation of MBUX SOUND DRIVE takes the long and successful brand partnership between Mercedes‑AMG and multi-platinum rapper will.i.am into exciting new territory. As the project progressed, will.i.am fostered the idea of using his skills as a record producer to develop an interactive music experience for the car. The technology connects the car hardware with the music software through precise ‘in-car signals’ that enable the music to react to the driving characteristics in real-time.

Platform power – digital driving music for everyone

Providing an immersive sound experience is just one part of the story. The long-term goal with MBUX SOUND DRIVE is to turn the technology into an open music platform. As a result, artists from around the world will be able to create tracks, representing any music genre, in a new immersive audio format using MBUX SOUND DRIVE studio software.

MBUX SOUND DRIVE rollout starts globally from mid-2024 and will be available on Mercedes-AMG and Mercedes-Benz vehicles equipped with the second-generation MBUX system.1 Existing Mercedes customers can access the MBUX Software Update via an over-the-air (OTA) update using the Update Wizard on their MBUX display or the Mercedes me app after receiving a notification that it is available in the U.S.

Dynamic demos at CES – immersive music on the road

To fully demonstrate the capabilities of MBUX SOUND DRIVE, Mercedes-AMG is offering exclusive test drives at CES 2024. Visitors can head outside to the MBUX SOUND DRIVE stand at the Diamond Lot and book an experience in a Mercedes-AMG EQE Sedan or EQE SUV. 

Mercedes-Benz takes in-car voice control to a new level with ChatGPT

MERCEDES-BENZ - Mercedes-Benz is further expanding the use of artificial intelligence and integrating it into the voice control of its vehicles as the next step. By adding ChatGPT, voice control via the MBUX Voice Assistant's Hey Mercedes will become even more intuitive. An optional beta program started on June 16, 2023 in the U.S. for over 900,000 vehicles equipped with the MBUX infotainment system1.

Customers can participate via the Mercedes me app or directly from the vehicle using the voice command "Hey Mercedes, I want to join the beta programme"2. The rollout of the beta programme will happen over the air. Mercedes-Benz is integrating ChatGPT through Azure OpenAI Service, leveraging the enterprise-grade capabilities of Microsoft's cloud and AI platform.

Addition for voice control via Hey Mercedes

Mercedes-Benz MBUX Voice Assistant has already set industry standards and is known for its intuitive operation and a large command portfolio. Driver and passengers can receive sports and weather updates, have questions answered about their surroundings or even control their smart homes.

ChatGPT complements the existing intuitive voice control via Hey Mercedes. While most voice assistants are limited to predefined tasks and responses, ChatGPT leverages a large language model to greatly improve natural language understanding and expand the topics to which it can respond.

Mercedes-Benz combines the best of both worlds, enhancing the validated data of MBUX Voice Assistant with the more natural dialogue format of ChatGPT. Users will experience a voice assistant that not only accepts natural voice commands but can also conduct conversations. Soon, participants who ask the Voice Assistant for details about their destination, to suggest a new dinner recipe, or to answer a complex question, will receive a more comprehensive answer – while keeping their hands on the wheel and eyes on the road.

Mercedes-Benz ensures data privacy

A collaboration with Microsoft enables the integration of ChatGPT. Through Azure OpenAI Service, Mercedes‑Benz is tapping OpenAI's large-scale generative AI models combined with the enterprise-grade security, privacy and reliability capabilities of Azure. Mercedes-Benz retains complete control over the IT processes in the background. The voice command data collected is stored in the Mercedes-Benz Intelligent Cloud, where it is anonymised and analysed.

Data protection is a top priority for Mercedes-Benz. Customers know at all times what information is collected and for what purpose, and they are free to make their own decisions. Mercedes-Benz protects all customer data from manipulation and misuse.

"The integration of ChatGPT with Microsoft in our controlled cloud environment is a milestone on our way to making our cars the centre of our customers' digital lives. Our beta programme boosts the existing Hey Mercedes functions such as navigation queries, weather requests and others with the capabilities of ChatGPT. This way, we aim to support conversations with natural dialogues and follow-up questions. Our customers can always rely on us to ensure the best possible protection of their data privacy. Everything is under one big goal: Redefining the relationship with your Mercedes."
Markus Schäfer, Member of the Board of Management of Mercedes-Benz Group AG, Chief Technology Officer, Development & Procurement

Mercedes-Benz gives customers the opportunity to try out the latest technologies in their vehicles as early adopters. The U.S. focused beta programme is expected to last three months. In return, Mercedes-Benz developers will gain helpful insights into specific requests, enabling them to set precise priorities in the further development of voice control. Findings from the beta programme will be used to further improve the intuitive voice assistant and to define the rollout strategy for large language models in more markets and languages.

ChatGPT in line with Mercedes-Benz AI principles

GPT stands for "Generative Pre-trained Transformer", a family of large language models that have been trained to create or summarize texts, answer questions, translate languages and even generate programming code. ChatGPT is built on a sophisticated neural network developed by the company OpenAI.

Mercedes-Benz is taking an approach to the integration of ChatGPT that aligns with the company's AI principles to make the benefits of innovative AI solutions accessible to customers. Mercedes-Benz keeps a close eye on potential risks and the system will be continuously improved for the benefit of all customers. A responsible approach to generative AI solutions is top priority at Mercedes-Benz.

1. All vehicles with MBUX of model series A 238, C 118, C 167, C 238, C 253, C 254, C 257, H 247, N 293, R 232, S 213, V 167, V 177, V 295, V 297, W 206, W 213, WV 223, X 167, X 243, X 247, X 253, X 254, X 294, X 296, Z 223 and Z 296.
2. Without the signing of a Mercedes me connect contract and the subsequent activation of the desired services in the Mercedes me Portal or the Mercedes me App, there will be no data transmission from the vehicle. This applies to all models and model series. Nevertheless, there are two exceptions in which certain data is transmitted at certain points: the Mercedes-Benz emergency call system and Mercedes-Benz information and breakdown call.