What is Google-Extended?
Google-Extended is a robots.txt control token that lets site owners tell Google whether their content may be used for Gemini models and for grounding in Gemini. It is not a separate crawler, and blocking it does not affect how your site is crawled or ranked in Google Search.
How it differs from Googlebot
Googlebot crawls for Google Search. Google-Extended is only a permission signal read from robots.txt. Disallowing it limits use of your content in Gemini, while search crawling continues as before.
Check your setup
Look for a Google-Extended rule in your robots.txt. The free checker reports whether it is allowed, blocked or partly restricted.
Check which AI crawlers your site allowsFree AI crawler checker: GPTBot, ClaudeBot, PerplexityBot and more.Related terms
Be first when Nodpick opens
Nodpick opens soon. Join the waitlist for early access and the launch price.