option
Home
News
Several US Media Outlets Block Internet Archive's Wayback Machine Crawler to Prevent AI Training Abuse

Several US Media Outlets Block Internet Archive's Wayback Machine Crawler to Prevent AI Training Abuse

June 28, 2026
53

As reported by Wired, several major media outlets and platforms—including The New York Times, Reddit, and USA Today's parent company—have recently blocked the Internet Archive's Wayback Machine. The move is intended to prevent AI companies from using the archive tool to indirectly scrape copyrighted material for model training.

Illustration of a robot hacker

The irony of blocking while benefiting

Ironically, USA Today's recent in-depth investigation into immigration policy statistics relied on historical data preserved by the Wayback Machine. Yet the media group's spokesperson stated they have fully blocked all crawlers, including ia_archiverbot, to address the growing risk of AI infringement.

How media organizations are applying restrictions

At least 23 mainstream news websites have now implemented restrictions:

Complete blocking: The New York Times and Reddit have directly blocked the Wayback Machine's dedicated crawler.

Interface filtering: The Guardian has not fully blocked crawlers but has excluded its content from the Internet Archive's API and filtered its search interface, making it extremely difficult for users to access historical archives.

In response to these blocking actions, over 100 active journalists, including Rachel Maddow, have co-signed a letter of support to the Electronic Frontier Foundation (EFF). They describe the Wayback Machine as an "indispensable tool" for fact-checking, tracking changes in the behavior of powerful institutions, and preserving digital history.

Publishers argue that AI companies training on the Internet Archive's vast data violates copyright law and directly competes with them. However, Internet Archive director Mark Graham warns that the ongoing closure of public web content is seriously undermining society's ability to understand historical truths and conduct public oversight. If this trend continues, a large portion of early digital records may be at risk of complete loss.

Related article
DeepMind CEO Hassabis: I sleep six hours a day, usually feel energetic around 1 a.m. DeepMind CEO Hassabis: I sleep six hours a day, usually feel energetic around 1 a.m. Fortune recently featured an interview with Demis Hassabis, CEO of Google DeepMind, revealing his unconventional approach to rest and productivity. Hassabis disclosed that he sleeps very little, structuring his waking hours into two distinct work blo
OpenAI, Anthropic Vie for Market Share Despite Revenue Shortfalls OpenAI, Anthropic Vie for Market Share Despite Revenue Shortfalls Despite recent reports suggesting OpenAI missed revenue targets, creating pressure on tech stocks this Tuesday, private AI lab investors remain resilient. Seasoned backers have confirmed they will not reduce investment despite negative media coverage
California AV Compliance: A New Era of Tickets, Geofences, and 1M Miles California AV Compliance: A New Era of Tickets, Geofences, and 1M Miles Guident operates an AuveTech shuttle in South Florida, managing a four-mile route in West Palm Beach and a one-mile route in Boca Raton using its remote monitoring technology. | Credit: GuidentCalifornia is redefining the regulatory landscape for dri
Related Special Topic Recommendations
chatbot Best AI Roleplay Chat Apps for Language Practice, Interview Prep, and Daily Fluency
Best AI Roleplay Chat Apps for Language Practice, Interview Prep, and Daily Fluency

2026 Latest Best Top-rated AI Roleplay Chat Apps for Language Practice, Interview Prep, and Daily Fluency! XIX.AI curates a powerful game-changing collection that offers free vs paid comparison, real-world tests, and updated rankings weekly. These must-try tools help you boost writing skills, overcome fluency challenges, and improve communication efficiency across all daily scenarios. Explore now to discover your perfect tool for language growth!

10 tools
xix.ai
Music composition AI Stem Separation Tools for Remix Production, Sampling Prep, and Karaoke Masters
AI Stem Separation Tools for Remix Production, Sampling Prep, and Karaoke Masters

2026 Latest Best Top-rated AI Stem Separation Tools Curated for Remix Production, Sampling Prep, and Karaoke Masters. These powerful game-changing tools offer real-world tests to deliver precise audio isolation, boosting productivity significantly. XIX.AI provides a weekly updated free vs paid comparison guide to help you find the must-try solution that suits your needs. Explore now to unlock your AI edge.

8 tools
xix.ai
Data Analysis AI SQL Copilots for Revenue Dashboards, Funnel Analysis, and Product Metrics
AI SQL Copilots for Revenue Dashboards, Funnel Analysis, and Product Metrics

2026 Latest Best AI SQL Copilots Ranked Top-Rated! XIX.AI curates a powerful game-changing collection for weekly updated real-world tests. These must-try tools help you generate accurate revenue dashboards, analyze sales funnels, and track product metrics swiftly, boosting productivity massively. Explore now to Discover your perfect tool for data-driven decision making! 238 characters

9 tools
xix.ai
Music composition Best AI Melody Writing Tools for Song Drafts
Best AI Melody Writing Tools for Song Drafts

2026 Latest Best Top-Rated AI Melody Writing Tools for Song Drafts! XIX.AI has curated a highly powerful game-changing collection that goes through rigorous real-world tests to deliver the best writing experience. You can find detailed free vs paid comparisons, accurate rankings, and must-try options designed to help you create stunning song drafts effortlessly and boost your creative productivity significantly. Explore now to discover your perfect tool!

8 tools
xix.ai
chatbot Best AI Conversation Trainer Tools for Interview Practice
Best AI Conversation Trainer Tools for Interview Practice

2026 Latest Best Top-rated AI Conversation Trainer Tools for Interview Practice are here on XIX.AI! This curated collection features powerful, game-changing tools that go through rigorous real-world tests to deliver accurate feedback. You’ll find a free vs paid comparison and detailed rankings to help you choose the must-try option that boosts your confidence and skills. Explore now to Discover your perfect tool for interview success!

12 tools
xix.ai
Design & Art Best AI Style Transfer Tools for Creative Experiments
Best AI Style Transfer Tools for Creative Experiments

2026 Latest Best Top-rated AI Style Transfer Tools for Creative Experiments! XIX.AI has curated a powerful, game-changing collection of must-try tools that deliver exceptional results through real-world tests and rigorous rankings. These top solutions help creatives boost productivity significantly by accelerating content creation and unlocking endless creative possibilities. Explore now to discover your perfect tool and start creating today!

9 tools
xix.ai
Comments (0)
0/500
OR