What is Applebot? User agent and robots.txt rules

Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.

AI search Follows robots.txt Apple

Applebot user agent

Apple documents the name only: requests contain “Applebot”.

robots.txt rules for Applebot

Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read. Not sure what your file does today? Run the AI crawler checker.

Block Applebot

Disallows every path for Applebot. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.

robots.txt
User-agent: Applebot
Disallow: /

Allow Applebot

Lets Applebot fetch every path, whatever “User-agent: *” says.

robots.txt
User-agent: Applebot
Allow: /

Good to know

If your robots.txt has no rules for Applebot, it follows your Googlebot rules. It ignores Crawl-delay. Use Applebot-Extended to opt out of training only.

Operator Apple
Used forAI search
robots.txtFollows robots.txt
robots.txt tokenApplebot
Documentationsupport.apple.com
Can Applebot reach your site? Enter your domain: we read your robots.txt and show Applebot’s status.

Applebot FAQ

What is Applebot?

Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.

How do I block Applebot?

Add “User-agent: Applebot” and “Disallow: /” to your robots.txt. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.

Does Applebot respect robots.txt?

Yes. Apple says Applebot follows robots.txt rules written for it.

What is the Applebot user agent?

Apple documents the name “Applebot”, which appears in its requests.

How can I verify Applebot requests?

Match the request IP against Apple’s published list (https://search.developer.apple.com/applebot.json). The user agent alone can be faked.

Does Applebot collect data for Apple’s AI?

Apple says Applebot’s data may also be used to train its generative AI foundation models. To opt out of training only, disallow Applebot-Extended: Applebot keeps powering search in Spotlight, Siri and Safari.

Source: support.apple.com, checked Nov 17, 2026. AI crawlers list and directory

Files are the start. Answers are the result.

Your buyers’ questions on up to eight AI engines, run as often as you choose, with full history. See whether ChatGPT mentions your brand.