Company
Meta
Type
Training crawl
Obeys robots.txt
Yes
Announces itself as
meta-externalagent, FacebookBot
Official documentation
https://developers.facebook.com/docs/sharing/bot/
What it does
Meta's crawler used to collect web data for training its AI models, including the Llama family. Obeys robots.txt.
How Forge AI Bot Log checks it
Visits are checked by reverse DNS against Meta's domains.
Should you block it?
Block it if you do not want your pages used to train Meta's models. Blocking meta-externalagent takes one switch in Forge AI Bot Log's Access Control screen. The plugin adds the rule to your robots.txt for you.