HomeGoogle’s AI Mode can now see and search with images
Google is enhancing its AI Mode chatbot with new multimodal capabilities, enabling it to "see" and respond to questions about images. This update, which integrates a custom version of Gemini AI with Google's Lens image recognition technology, allows users to take or upload photos and receive detailed, informative responses complete with relevant links. The rollout of this feature began today and is accessible through the Google app on both Android and iOS devices.
Robby Stein, VP of Product for Google Search, explains, "AI Mode builds on our years of work in visual search, but takes it a step further. With Gemini’s multimodal capabilities, AI Mode can now understand the entire scene within an image, including how objects interact and their specific materials, colors, shapes, and arrangements."
The update employs a "fan-out technique" that sends out multiple queries about the image and its elements, resulting in responses that are both nuanced and contextually relevant. This allows AI Mode to identify items like books in an image, suggest similar titles with good reviews, and even answer follow-up questions to refine recommendations.
Now Google’s AI Mode can ‘see’ what you see to better assist with inquiries. GIF: Google
Designed as a competitor to Perplexity and ChatGPT Search, AI Mode offers a chatbot-like experience, generating AI-powered summaries from Google's vast search index. Initially exclusive to Google One AI Premium subscribers through Labs last month, AI Mode is now expanding to "millions more" Labs users in the US, extending beyond just the paid AI Premium subscribers.
Related article
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (17)
0/500
![BruceWalker]()
這功能也太酷了吧！以後看到不認識的植物或零件，直接拍照問AI就好，不用再絞盡腦汁描述半天了。不過隱私問題還是讓人擔心，照片上傳後會被怎麼處理呢？希望Google能說清楚。
![WilliamMiller]()
Finalmente! Agora dá pra tirar foto de alguma coisa e o Google me explica o que é? 🤯 Mas, sério... será que vai funcionar direito na minha região? Acho que vou testar com meu gato primeiro, pra ver se ele reconhece a raça kkk. Se funcionar, vai acabar com minhas brigas de família sobre nomes de plantas no jardim.
![DouglasCarter]()
Этот новый функционал с картинками выглядит круто, но я уже представляю, как это повлияет на приватность. 🤔 Интересно, сколько данных Google теперь сможет собирать через изображения? Технология развивается так быстро, что иногда становится немного страшно.
![WillLopez]()
AI 가 이미지를 '보고' 검색을 한다니, 정말 신기하네요 🔍 구글이 제미니 + 렌즈 기술을 결합한 건데... 나중에 써보면서 어떤 제품 구매할 때 도움이 되면 좋겠어요! 근데 이렇게 사진 업로드를 하면서 개인정보도 같이 수집되는 건 아닐지 조금 걱정스럽기도 하네.
![FredScott]()
This is wild! Google's AI can now 'see' images? I tried it with a pic of my dog, and it described his goofy grin perfectly. Kinda creepy but super cool! 🐶
![DavidGonzález]()
This is wild! Google's AI can now 'see' images? I just tried uploading a pic of my dog, and it described it perfectly—kinda creepy but super cool! 🐶
Google is enhancing its AI Mode chatbot with new multimodal capabilities, enabling it to "see" and respond to questions about images. This update, which integrates a custom version of Gemini AI with Google's Lens image recognition technology, allows users to take or upload photos and receive detailed, informative responses complete with relevant links. The rollout of this feature began today and is accessible through the Google app on both Android and iOS devices.
Robby Stein, VP of Product for Google Search, explains, "AI Mode builds on our years of work in visual search, but takes it a step further. With Gemini’s multimodal capabilities, AI Mode can now understand the entire scene within an image, including how objects interact and their specific materials, colors, shapes, and arrangements."
The update employs a "fan-out technique" that sends out multiple queries about the image and its elements, resulting in responses that are both nuanced and contextually relevant. This allows AI Mode to identify items like books in an image, suggest similar titles with good reviews, and even answer follow-up questions to refine recommendations.
Designed as a competitor to Perplexity and ChatGPT Search, AI Mode offers a chatbot-like experience, generating AI-powered summaries from Google's vast search index. Initially exclusive to Google One AI Premium subscribers through Labs last month, AI Mode is now expanding to "millions more" Labs users in the US, extending beyond just the paid AI Premium subscribers.
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Google AI Overviews Gain Ground in Search Results
According to Similarweb’s 2026 Generative AI Landscape report, Google’s AI-generated summaries appeared in 43% of US searches, a significant rise from 15% recorded a year prior.While AI Overviews present generated summaries within standard search res
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
這功能也太酷了吧！以後看到不認識的植物或零件，直接拍照問AI就好，不用再絞盡腦汁描述半天了。不過隱私問題還是讓人擔心，照片上傳後會被怎麼處理呢？希望Google能說清楚。
Finalmente! Agora dá pra tirar foto de alguma coisa e o Google me explica o que é? 🤯 Mas, sério... será que vai funcionar direito na minha região? Acho que vou testar com meu gato primeiro, pra ver se ele reconhece a raça kkk. Se funcionar, vai acabar com minhas brigas de família sobre nomes de plantas no jardim.
Этот новый функционал с картинками выглядит круто, но я уже представляю, как это повлияет на приватность. 🤔 Интересно, сколько данных Google теперь сможет собирать через изображения? Технология развивается так быстро, что иногда становится немного страшно.
AI 가 이미지를 '보고' 검색을 한다니, 정말 신기하네요 🔍 구글이 제미니 + 렌즈 기술을 결합한 건데... 나중에 써보면서 어떤 제품 구매할 때 도움이 되면 좋겠어요! 근데 이렇게 사진 업로드를 하면서 개인정보도 같이 수집되는 건 아닐지 조금 걱정스럽기도 하네.
This is wild! Google's AI can now 'see' images? I tried it with a pic of my dog, and it described his goofy grin perfectly. Kinda creepy but super cool! 🐶
This is wild! Google's AI can now 'see' images? I just tried uploading a pic of my dog, and it described it perfectly—kinda creepy but super cool! 🐶
