What is Meta-ExternalAgent? User agent and robots.txt rules
Meta-ExternalAgent crawls the web to train Meta’s foundation AI models or to improve products by indexing content directly.
Meta-ExternalAgent user agent
As documented by Meta. Version numbers change; match on the token.
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
robots.txt rules for Meta-ExternalAgent
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read. Not sure what your file does today? Run the AI crawler checker.
Block Meta-ExternalAgent
Disallows every path for Meta-ExternalAgent. That keeps your future pages out of what Meta may use for training. It does not change search results.
User-agent: meta-externalagent Disallow: /
Allow Meta-ExternalAgent
Lets Meta-ExternalAgent fetch every path, whatever “User-agent: *” says.
User-agent: meta-externalagent Allow: /
Good to know
Meta says crawlers may cache your robots.txt for up to 24 hours.
meta-externalagentMeta-ExternalAgent FAQ
What is Meta-ExternalAgent?
Meta-ExternalAgent crawls the web to train Meta’s foundation AI models or to improve products by indexing content directly.
How do I block Meta-ExternalAgent?
Add “User-agent: meta-externalagent” and “Disallow: /” to your robots.txt. That keeps your future pages out of what Meta may use for training. It does not change search results.
Does Meta-ExternalAgent respect robots.txt?
Yes. Meta says Meta-ExternalAgent follows robots.txt rules written for it.
What is the Meta-ExternalAgent user agent?
Meta documents it as “meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)”. Version numbers change, so match on “meta-externalagent”.
How can I verify Meta-ExternalAgent requests?
Meta publishes no IP list for Meta-ExternalAgent. Treat the user agent as a hint, not proof.
Source: developers.facebook.com, checked Nov 17, 2026. AI crawlers list and directory
Files are the start. Answers are the result.
Your buyers’ questions on up to eight AI engines, run as often as you choose, with full history. See whether ChatGPT mentions your brand.