Glossary · G
Google-Extended
Google-Extended is a robots.txt token that controls whether a site’s content may be used to train Google’s Gemini models; it does not affect crawling for Google Search or AI features in search.
Extended definition
In more detail.
Disallowing Google-Extended withholds content from model training without removing the site from search, AI Overviews or AI Mode, which continue to rely on Googlebot. Organizations sometimes block it expecting to stop AI use entirely, or allow it expecting to improve visibility; neither follows. The token is a training-use decision only, and should be made on that basis.
In our work
Where it appears.
The crawler allow-list on this site is decided explicitly and documented. See crawl and render readiness.
By David Selakovic · Published 2026-10-16 · Revised 2026-10-16 · Reviewed every 180 days