Google Rolls Out Real-Time Gemini AI Video Features

Google is now rolling out new AI features for Gemini Live, allowing it to analyze your smartphone screen or camera feed and answer related questions in real time, Google spokesperson Alex Joseph confirmed to The Verge via email. These capabilities arrive almost a year after Google's initial "Project Astra" demonstration, which serves as their foundation.
A Reddit user first reported seeing the feature appear on their Xiaomi device, as noted by 9to5Google. That same user has now shared a video showcasing Gemini's new screen-reading function. This is one of the two features Google announced in early March would "begin rolling out to Gemini Advanced subscribers as part of the Google One AI Premium plan" later that month.
The second Astra feature now launching is live video interpretation. It enables Gemini to process the feed from your phone's camera in real time and respond to questions about what it sees. In a demonstration video published by Google this month, a user asks Gemini for advice on choosing a paint color for a newly glazed pottery piece.
This rollout highlights Google's significant lead in the AI assistant space. The launch comes as Amazon prepares a limited early access phase for its upgraded Alexa Plus, and Apple has delayed its enhanced Siri. Both competitors aim to offer capabilities similar to what Astra is now deploying. Samsung continues to offer Bixby, though Gemini remains the default assistant on its latest phones.
Related article
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
Related Special Topic Recommendations
Comments (2)
0/500
Finally, a real use case for Gemini Live! 📱 Being able to point my camera at a weird gadget and get instant answers without typing feels like magic. This could save so much time when I'm shopping or fixing things around the house. Can't wait to test it out on my daily commute!

Google is now rolling out new AI features for Gemini Live, allowing it to analyze your smartphone screen or camera feed and answer related questions in real time, Google spokesperson Alex Joseph confirmed to The Verge via email. These capabilities arrive almost a year after Google's initial "Project Astra" demonstration, which serves as their foundation.
A Reddit user first reported seeing the feature appear on their Xiaomi device, as noted by 9to5Google. That same user has now shared a video showcasing Gemini's new screen-reading function. This is one of the two features Google announced in early March would "begin rolling out to Gemini Advanced subscribers as part of the Google One AI Premium plan" later that month.
The second Astra feature now launching is live video interpretation. It enables Gemini to process the feed from your phone's camera in real time and respond to questions about what it sees. In a demonstration video published by Google this month, a user asks Gemini for advice on choosing a paint color for a newly glazed pottery piece.
This rollout highlights Google's significant lead in the AI assistant space. The launch comes as Amazon prepares a limited early access phase for its upgraded Alexa Plus, and Apple has delayed its enhanced Siri. Both competitors aim to offer capabilities similar to what Astra is now deploying. Samsung continues to offer Bixby, though Gemini remains the default assistant on its latest phones.
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
Finally, a real use case for Gemini Live! 📱 Being able to point my camera at a weird gadget and get instant answers without typing feels like magic. This could save so much time when I'm shopping or fixing things around the house. Can't wait to test it out on my daily commute!





Home






