Google Brings Real-Time Vision to Gemini Live on Android

These updates are based on the technology behind Project Astra, which the company first showed off in May 2024.

Currently, they appear limited to select Android phones, with one early case reported on a Xiaomi device using the $19.99/month Gemini Advanced plan. Google has said that Pixel and Galaxy S25 users will likely be among the first to receive full access to these tools.

Did you know?

Want to get smarter & wealthier with crypto?

Subscribe - We publish new crypto explainer videos every week!

What is AVAX? (Avalanche Network Explained With Animations)

SUBSCRIBE

ON YOUTUBE

Some Android users, including one with a Xiaomi device, have already noticed the changes. That user shared a video showing Gemini reacting to on-screen content as it was happening.

Another feature lets Gemini view a live video from the phone’s camera and respond to what it sees. In a demonstration by Google, a user asked the assistant to suggest a paint color for pottery they had just finished glazing. The assistant gave advice based on what it saw through the camera feed.

To use the screen-sharing function, users must open Gemini Live and tap a new button labeled "Share screen with Live". This feature currently only supports sharing the whole screen—not individual apps.

Meanwhile, users need to start a video session within Gemini Live to start the cameral tool. A small icon in the corner of the screen allows them to switch to the front-facing camera and begin using the assistant that way.

On March 12, Google introduced Gemma 3, the latest version of its lightweight AI models. How does it compare to earlier versions? Read the full story.