Mercedes tests ChatGPT in US beta programme

  • July 18, 2023
  • Steve Rogerson

Mercedes-Benz is using ChatGPT in its MBUX beta programme for US customers via the Microsoft Azure OpenAI service.

The car maker is expanding the use of artificial intelligence (AI) and integrating it into the voice control of its vehicles. By adding ChatGPT, voice control via the MBUX Voice Assistant’s Hey Mercedes should become more intuitive.

An optional beta programme started last month in the USA for more than 900,000 vehicles equipped with the MBUX infotainment system.

Users can participate via the Mercedes Me app or directly from the vehicle using the voice command “Hey Mercedes, I want to join the beta programme”.

The rollout of the beta programme will happen over the air. Mercedes-Benz is integrating ChatGPT through the Azure OpenAI service.

With the MBUX Voice Assistant, driver and passengers can receive sports and weather updates, have questions answered about their surroundings or even control their smart homes.

ChatGPT complements the existing intuitive voice control via Hey Mercedes. It leverages a large language model to improve natural language understanding and expand the topics to which it can respond.

Users should experience a voice assistant that not only accepts natural voice commands but can also conduct conversations. Soon, participants who ask the voice assistant for details about their destination, to suggest a new dinner recipe, or to answer a complex question, will receive a more comprehensive answer while keeping their hands on the wheel and eyes on the road.

The collaboration with Microsoft sees Mercedes‑Benz tapping OpenAI’s large-scale generative AI models combined with the enterprise-grade security, privacy and reliability capabilities of Azure.

Mercedes-Benz retains complete control over the IT processes in the background. The voice command data collected are stored in the Mercedes-Benz Intelligent Cloud, where they are anonymised and analysed.

Customers know at all times what information is collected and for what purpose, and they are free to make their own decisions.

“The integration of ChatGPT with Microsoft in our controlled cloud environment is a milestone on our way to making our cars the centre of our customers’ digital lives,” said Markus Schäfer, Mercedes-Benz chief technology officer. “Our beta programme boosts the existing Hey Mercedes functions such as navigation queries, weather requests and others with the capabilities of ChatGPT.”

The beta programme is expected to last three months. Findings from the programme will be used to improve the intuitive voice assistant and to define the rollout strategy for large language models in more markets and languages.