Skip to content
Company xAI
Type Live read
Obeys robots.txt Not always
Announces itself as Grok-DeepSearch
Official documentation https://x.ai

What it does

Fetches pages live for Grok's DeepSearch research mode. Like Grok's other fetchers it often uses disguised browser user agents, so hits under this name understate real Grok activity.

How Forge AI Bot Log checks it

xAI publishes no way to check this bot, so visits are recorded as No check rather than guessed at.

Should you block it?

Your choice. Use the server-level block if you block it. Blocking Grok-DeepSearch takes one switch in Forge AI Bot Log's Access Control screen. The plugin adds the rule to your robots.txt for you. Grok-DeepSearch may not honour robots.txt, so the plugin also gives you a server-level block to paste into .htaccess.