Big Google Home update lets Gemini describe live camera feeds

"So, instead of Gemini only knowing about things that have already happened, it now understands what it sees in your live camera feeds. That means you can ask things like, "Hey Google, is there a car in the driveway?""

"Gemini now understands context better, too, which should improve how it targets smart devices. For example, saying "turn off the kitchen" will now target just the lights in the room, instead of every smart device. And commands like "turn off all the lights" will apply to your current location, and not target the lights in a secondary location."

"Gemini for Home is now also using updated models. A change that should improve the quality and accuracy of answers to general questions, and help with playback of newly-released songs."

Google Home has released significant updates to its smart home platform addressing various user frustrations. The most notable addition is Live Search, enabling Gemini to analyze live camera feeds and answer real-time questions about home activity. Gemini for Home now uses updated AI models that improve answer quality, accuracy for general questions, and music playback capabilities. Enhanced context understanding allows more precise device targeting—for example, "turn off the kitchen" now affects only kitchen lights rather than all devices, and location-aware commands prevent accidentally controlling devices in secondary locations like cabins or parents' homes.

Read at The Verge