Gemini Live is expanding and can now talk about what's on your screen

If you're rocking a Pixel 9, you're in for a treat with the latest update from Google. Now, you can let Gemini take a look at your screen and chat about whatever's on it, be it a YouTube video, an image, or a file. This cool feature was unveiled last week at Samsung Unpacked, where Google also shared a bunch of new goodies coming to Pixel phones.

And hey, if you're into deep dives, Gemini's Deep Research feature is now available on the Android app for free. It's like having a personal researcher browsing the web for you!

According to a report from 9to5Google, this screen-sharing feature is starting to appear on Pixel 9 series devices. If you haven't seen it yet, don't worry—it should pop up soon.

How to Test Gemini Live on Your Phone

To give this feature a whirl, fire up Gemini Live by saying "Hey Google" (not through the Gemini app). You'll spot a mic button at the bottom for voice queries, a text field for typing out your commands and questions, a plus icon to add attachments, and the new "Talk Live about…" button.

When you tap that button, Gemini will upload whatever's on your screen to Gemini Live, and the conversation kicks off. You can also use this feature later in a conversation if you need to set up some context or parameters first.

There's also a handy quick capture camera option if you want to send Gemini a visual without leaving the chat.

Now, if you're asking about an image or a YouTube video, Gemini only sees what's on your screen. But if you're dealing with a PDF, Gemini gets access to the whole file.

This feature is super handy when you're using the YouTube or Files by Google apps, or just viewing an image. Before, you'd have to take a screenshot and manually upload it as an attachment. Now, it's all streamlined and saves you a step.

Availability

Google's rolling out this feature starting with the Galaxy S24, S25, and Pixel 9. But don't fret if you've got a different Android device; it's likely to come your way eventually.