NOISEReport
Coverage history

Assembled by NOISE.

Report / Tech

Published by NOISE

Google joins OpenAI and Anthropic in AI scraping opt-out

From Morning NOISE.

Google, OpenAI, Anthropic, and Microsoft committed to honoring a new robots.txt directive that lets publishers block AI training crawlers with a single signal. The standard, proposed by Anthropic's Kevin Kelley at the IETF, uses a new user agent, __usage_ai-training, allowing website owners to disallow or selectively allow scraping for generative AI. Anthropic already supports the directive; Microsoft plans support on February 1, 2027, and Google in early 2027, while OpenAI will implement it in the coming months. The rule applies only to future scraping, so it cannot undo previously collected content.

Saved versions

These dates record changes to NOISE’s copy. They are not event dates.

  1. Saved copyCurrentIn saved edition