RecodeAI Discuss your AI agenda
🟡 Notable

OpenAI, Google, Microsoft, Anthropic Back Scraping Opt-Out Standard

recodeai Staff · Nov 2, 2026 · Policy · 2 min read
The story

The four AI leaders will adopt a new standard letting publishers opt out of having their content scraped for AI training.

OpenAI, Google, Microsoft, and Anthropic have agreed to adopt a new technical standard that gives publishers a clearer mechanism to opt out of AI scraping. The move follows years of friction between AI labs and media companies over unauthorized use of content for training.

Publishers will be able to apply the standard across their sites, giving them more granular control than existing robots.txt conventions currently allow.

Why it matters

This is a meaningful concession from the industry's biggest training-data consumers and could reshape licensing leverage for publishers and content businesses. Companies that depend on web content for training or retrieval should treat this as the start of a more formalized, and likely monetized, data supply chain.

Sources: The Verge

The daily signal, curated. Get it in your inbox.

Subscribe on LinkedIn →