What is Meta-ExternalFetcher? User agent and robots.txt rules

Meta-ExternalFetcher fetches individual links at a user’s request, for example to help Meta AI complete a task on a website.

User-triggered May skip robots.txt Meta

Meta-ExternalFetcher user agent

As documented by Meta. Version numbers change; match on the token.

User agent
meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)

robots.txt rules for Meta-ExternalFetcher

Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read. Not sure what your file does today? Run the AI crawler checker.

Block Meta-ExternalFetcher

Disallows every path for Meta-ExternalFetcher. That asks Meta not to fetch your pages when its users ask, though Meta says user-triggered fetches may not always follow robots.txt.

robots.txt
User-agent: meta-externalfetcher
Disallow: /

Allow Meta-ExternalFetcher

Lets Meta-ExternalFetcher fetch every path, whatever “User-agent: *” says.

robots.txt
User-agent: meta-externalfetcher
Allow: /

Good to know

Meta says it may bypass robots.txt, because the fetch was requested by a user.

Operator Meta
Used forUser-triggered
robots.txtMay skip robots.txt
robots.txt tokenmeta-externalfetcher
IP rangesNot published
Can Meta-ExternalFetcher reach your site? Enter your domain: we read your robots.txt and show Meta-ExternalFetcher’s status.

Meta-ExternalFetcher FAQ

What is Meta-ExternalFetcher?

Meta-ExternalFetcher fetches individual links at a user’s request, for example to help Meta AI complete a task on a website.

How do I block Meta-ExternalFetcher?

Add “User-agent: meta-externalfetcher” and “Disallow: /” to your robots.txt. That asks Meta not to fetch your pages when its users ask, though Meta says user-triggered fetches may not always follow robots.txt.

Does Meta-ExternalFetcher respect robots.txt?

Meta says that because a person starts these requests, robots.txt rules may not apply to Meta-ExternalFetcher.

What is the Meta-ExternalFetcher user agent?

Meta documents it as “meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)”. Version numbers change, so match on “meta-externalfetcher”.

How can I verify Meta-ExternalFetcher requests?

Meta publishes no IP list for Meta-ExternalFetcher. Treat the user agent as a hint, not proof.

Source: developers.facebook.com, checked Nov 17, 2026. AI crawlers list and directory

Files are the start. Answers are the result.

Your buyers’ questions on up to eight AI engines, run as often as you choose, with full history. See whether ChatGPT mentions your brand.