Google's AI Mode Now Enables Users to Pose Complex Image-Related Questions

Google's AI Mode is shaking things up in the world of search, and it's all about going deeper into your queries. This experimental feature on Google Search now lets users dive into complex, multi-part questions and follow-ups, making it easier to explore topics in depth. And guess what? If you're one of the lucky users with access to AI Mode, you can now tap into this feature to ask questions about photos you've uploaded or snapped with your camera. Exciting, right?

Google announced this nifty upgrade in a blog post on Monday, revealing that the new image-analyzing magic in AI Mode is powered by Google Lens' multimodal capabilities. This means AI Mode can now take a good look at the entire scene in an image, understanding how objects relate to each other, as well as their materials, colors, shapes, and arrangement. Pretty impressive, if you ask me!

Using a technique called "query fan-out," AI Mode doesn't just stop at the surface. It asks multiple questions about both the image and the objects in it, giving you more detailed information than a regular Google search. For instance, imagine snapping a photo of your bookshelf and asking, "If I enjoyed these, what are some similar books that are highly rated?" AI Mode will identify each book on your shelf and then serve up a list of recommended books, complete with links to learn more about them or even purchase them. How cool is that?

But wait, there's more! AI Mode also lets you refine your search with follow-up questions. Let's say you're in the mood for a quick read. You could ask, "I'm looking for a quick read. Which one of these recommendations is the shortest?" and AI Mode will help you find the perfect book in no time.

In Monday's announcement, Google also shared some good news for more users. AI Mode is now rolling out to millions more people who are part of Labs, Google's playground for experimental features and products. Before this, you had to be a Google One AI Premium subscriber to get your hands on it.

Launched just last month, AI Mode is Google's answer to services like Perplexity and OpenAI's ChatGPT Search. And Google isn't stopping there; they're committed to refining the user experience and expanding the feature's functionality. So, keep an eye out for more exciting updates from Google's AI Mode!