Skip to content
Company xAI
Type Search crawl
Obeys robots.txt Not always
Announces itself as xAI-Grok
Official documentation https://x.ai

What it does

Supports Grok's web search, indexing pages so Grok can cite them in answers. Grok's search traffic frequently arrives under generic browser user agents rather than this token, so it may be under-counted.

How Forge AI Bot Log checks it

xAI publishes no way to check this bot, so visits are recorded as No check rather than guessed at.

Should you block it?

Your choice. Use the server-level block if you block it. Blocking xAI-Grok takes one switch in Forge AI Bot Log's Access Control screen. The plugin adds the rule to your robots.txt for you. xAI-Grok may not honour robots.txt, so the plugin also gives you a server-level block to paste into .htaccess.