Company
xAI
Type
Training crawl
Obeys robots.txt
Yes
Announces itself as
GrokBot
Official documentation
https://x.ai
What it does
xAI's crawler, gathering content used to train the Grok models. xAI publishes no official crawler documentation or IP list, and much of Grok's fetching has been observed using generic browser user agents instead — so logged hits are a minimum, not the full picture.
How Forge AI Bot Log checks it
xAI publishes no way to check this bot, so visits are recorded as No check rather than guessed at.
Should you block it?
Block it if you do not want your pages training Grok. Be aware that Grok's disguised fetching cannot be blocked by name. Blocking GrokBot takes one switch in Forge AI Bot Log's Access Control screen. The plugin adds the rule to your robots.txt for you.