All news

30 October 2026 · Source: The Verge

OpenAI, Google, Microsoft to support a shared robots.txt AI opt-out

OpenAI, Google, Microsoft, and Anthropic say they will adopt a shared “policy token” that lets publishers opt out of AI scraping. The signal lives in a site’s robots.txt and applies training preferences across multiple providers; it was proposed to the IETF by Anthropic standards lead Kevin Kelley.

What's in it for you?

As this standard rolls out, you can plan to use the robots.txt signal to manage whether your content is used for AI training in one place. Agencies and small businesses can standardize the same control across client sites.

Read the original article (The Verge)

This summary was prepared from the source article with the help of AI. Our editorial policy