What is Applebot? User agent and robots.txt rules
Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.
Applebot user agent
Apple documents the name only: requests contain “Applebot”.
robots.txt rules for Applebot
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read. Not sure what your file does today? Run the AI crawler checker.
Block Applebot
Disallows every path for Applebot. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.
User-agent: Applebot Disallow: /
Allow Applebot
Lets Applebot fetch every path, whatever “User-agent: *” says.
User-agent: Applebot Allow: /
Good to know
If your robots.txt has no rules for Applebot, it follows your Googlebot rules. It ignores Crawl-delay. Use Applebot-Extended to opt out of training only.
ApplebotApplebot FAQ
What is Applebot?
Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.
How do I block Applebot?
Add “User-agent: Applebot” and “Disallow: /” to your robots.txt. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.
Does Applebot respect robots.txt?
Yes. Apple says Applebot follows robots.txt rules written for it.
What is the Applebot user agent?
Apple documents the name “Applebot”, which appears in its requests.
How can I verify Applebot requests?
Match the request IP against Apple’s published list (https://search.developer.apple.com/applebot.json). The user agent alone can be faked.
Does Applebot collect data for Apple’s AI?
Apple says Applebot’s data may also be used to train its generative AI foundation models. To opt out of training only, disallow Applebot-Extended: Applebot keeps powering search in Spotlight, Siri and Safari.
Source: support.apple.com, checked Nov 17, 2026. AI crawlers list and directory
Files are the start. Answers are the result.
Your buyers’ questions on up to eight AI engines, run as often as you choose, with full history. See whether ChatGPT mentions your brand.