Google Rejects Offering Publishers More Options to Opt Out of AI Search

Google's Internal Documents Reveal Publisher Control Controversy

According to a recently disclosed internal document obtained by Bloomberg, Google considered allowing publishers more granular control over how their content is utilized in AI-driven search features. The document, authored by Google Search executive Chetna Bindra, surfaced during the ongoing US antitrust trial examining Google’s dominance in online search. This trial has shed light on how Google’s control over its search engine data gives it a significant edge over competitors like Perplexity and OpenAI when it comes to AI development.

Bindra’s document outlines various proposals Google considered as AI search evolved. One suggestion labeled a “hard red line” would have allowed publishers to block real-time usage of their data by Google’s AI models, while still permitting their content to be used for broader feature training like AI Overviews. Another option, marked as “likely unstable,” proposed giving publishers the ability to completely opt out of indexing on Google Search entirely if they were dissatisfied.

Publisher Challenges and Publisher Control Options

During a recent court hearing on May 2nd, it became clear that publishers are navigating a complex landscape. Although Google introduced a method for publishers to opt out of AI training in 2023, this does not extend to search-specific AI products like AI Overviews. To avoid having their content included in AI Overviews, publishers must opt out of Googlebot crawling, effectively preventing their websites from appearing in regular search results.

Last year, when AI Overviews launched, Google chose to “silently update” the information regarding publisher controls without making a public announcement. Guidance on how to communicate this change suggests that Google deliberately obscured the details to avoid confusion about the distinctions between training for different AI models like Gemini and AI Overviews.

In the document, Bindra noted, “Do what we say, say what we do, but carefully.”

Google’s Stance on Publisher Control

Google maintains that this document reflects only early considerations as AI search developed. A Google spokesperson, Peter Schottenfels, stated in response to inquiries from The Verge, “Publishers have always had control over how their content is made available to Google, as AI models have been integrated into Search for years, helping to surface relevant sites and drive traffic to them. New search features like AI Overviews have increased the number of searches, creating new opportunities for sites to be discovered.”

Currently, Google’s messaging is more direct, stating that publishers who opt out of AI Overviews and AI Mode will also exclude their content from all forms of search results.

Image: Google