Report / Tech
Published by NOISE
Google joins OpenAI and Anthropic in AI scraping opt-out
From Morning NOISE.
Google, OpenAI, Anthropic, and Microsoft committed to honoring a new robots.txt directive that lets publishers block AI training crawlers with a single signal. The standard, proposed by Anthropic's Kevin Kelley at the IETF, uses a new user agent, __usage_ai-training, allowing website owners to disallow or selectively allow scraping for generative AI. Anthropic already supports the directive; Microsoft plans support on February 1, 2027, and Google in early 2027, while OpenAI will implement it in the coming months. The rule applies only to future scraping, so it cannot undo previously collected content.
Saved versions
These dates record changes to NOISE’s copy. They are not event dates.