Company
Meta
Type
Live read
Obeys robots.txt
Yes
Announces itself as
meta-externalfetcher
Official documentation
https://developers.facebook.com/docs/sharing/bot/
What it does
Fetches individual pages on demand to support Meta AI assistant features, rather than bulk crawling for training.
How Forge AI Bot Log checks it
Visits are checked by reverse DNS against Meta's domains.
Should you block it?
Allow it if you want Meta AI to be able to read your pages when people ask. Blocking meta-externalfetcher takes one switch in Forge AI Bot Log's Access Control screen. The plugin adds the rule to your robots.txt for you.