AllInfo AI
SITE OWNERS
The shared robots.txt signal, explained simply.
WHAT CHANGED
On 30 October 2026, Google, Anthropic, OpenAI and Microsoft said they will honor one shared training opt out.
THE RULE
Add User-Agent: __usage_ai-training then Disallow: / to your robots.txt file to opt your whole site out.
START DATES
• Anthropic: support started rolling out
• Microsoft: 1 February 2027
• Google: early 2027; OpenAI: no date yet
SEO SAFE
The rule covers training, not crawling. Googlebot and Bingbot keep indexing your pages as before.
GEMINI DETAIL
If you use the token without naming Google-Extended, Google treats it as blocked, which can drop you from Gemini grounding.
WORDPRESS
1. Open Yoast, Tools, File editor
2. Add the rule in its own block
3. Keep old GPTBot rules for now
GET IT RIGHT
See the full syntax, folder exceptions and how it differs from old crawler blocks.