The Volvo EX60 Can Literally See The World And Chat With You About It Using Gemini AI

Volvo and Google demonstrated Gemini AI integrated with the EX60 electric crossover’s cameras. The system lets occupants chat about what the vehicle sees using a Google-based infotainment experience. Gemini can scan road signs, translate text from other languages, and describe meanings in real time. During the showcase, the assistant identified a tall building visible down the street as the Transamerica Pyramid in San Francisco, described it as mainly an office building, and noted a park at its base. The assistant also offered to help plan a route to a nearby location. The feature remains unreleased and timing is not provided.

"Volvo and Google have teamed up to demonstrate how Gemini can integrate with a vehicle's cameras. The new EX60 electric crossover is the first car where Google's Gemini AI assistant can chat with occupants about their surroundings. The project has not been released publicly yet, but it looks really promising."

"At this year's Google I/O event, Volvo teamed up with the American tech giant to showcase how the Gemini AI assistant that's baked into cars with a Google-based infotainment system can grab information directly from the new EX60's cameras, interpret it in real time, and deliver knowledgeable answers to the driver or passengers."

"The driver can use voice commands to ask the car about a road sign that has words written in another language, and Gemini will automatically scan it, translate it, and describe what it means. As part of the demonstration, the system was asked to describe a tall building that could be seen at the end of the street, and whether or not there was anything to do in or around it."

"Gemini replied that it was the Transamerica Pyramid in San Francisco, and that it's mainly an office building, so not really a tourist attraction, but there is a park at its base. Additionally, the AI voice assistant asked if it should plan a route to a spot nearby. If you've ever used Google Lens on your smartphone, this is a similar experience, only supercharged with Gemini and natural voice commands."

Read at insideevs.com