AI crawler · Amazon

Amazonbot: what it is and how to block it

Amazonbot crawls the web to improve Amazon's products and services, and Amazon says the content may be used to train its AI models.

BrandVector Editorial · Last verified Oct 8, 2026

Operator
Amazon
Type
AI training
robots.txt token
Amazonbot
Follows robots.txt
Yes, per Amazon
IP ranges
Published
Blocked by name
7.6% of top sites

What is Amazonbot?

Amazonbot is Amazon's AI training crawler: it collects content that may be used to train AI models. In Amazon's words:

“Amazonbot is used to improve our products and services. This helps us provide more accurate information to customers and may be used to train Amazon AI models.”

“Each user agent setting is independent of the others, and may take ~24 hours for our systems to reflect changes.”

Amazonbot user agent string

Amazon documents this user agent string for Amazonbot:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36

In robots.txt, use the token Amazonbot, not the full string. Crawlers match on the token, and version numbers in the full string can change.

How many websites block Amazonbot?

In our Oct 8, 2026 check of 817 of the most-visited websites, 7.6% block Amazonbot by name for their whole site (62 sites).

robots.txt rule for AmazonbotSitesShare
Blocks the whole site by name627.6%
Blocks part of the site by name425.1%
Names it but doesn't block it70.9%
Blocked only by a catch-all (*) rule253.1%

For comparison, 0.1% of the same sites block Googlebot by name. The sites are the top 1,000 origins in the Chrome UX Report for August 2026; see how we measured.

How to block Amazonbot in robots.txt

Add this group to the robots.txt file at the root of your domain to block Amazonbot from your whole site:

User-agent: Amazonbot
Disallow: /

To block only part of your site, list those paths instead:

User-agent: Amazonbot
Disallow: /private/

A group that names Amazonbot replaces your User-agent: * rules for it entirely (RFC 9309). If your catch-all group blocks paths that Amazonbot should also stay out of, repeat them in its group. To let Amazonbot in while a catch-all rule blocks others:

User-agent: *
Disallow: /

User-agent: Amazonbot
Allow: /

“Automated crawling from these listed user agents respects the Robots Exclusion Protocol, honoring the user-agent and the allow/disallow directives.”

What happens if you block Amazonbot?

Amazon doesn't document what blocking Amazonbot changes.

How to verify requests from Amazonbot

Amazon publishes the IP addresses Amazonbot uses. Check a request's IP address against that list before trusting its user agent, which any client can fake.

See every AI crawler and how often top sites block it

Sources

  1. Amazon: Amazonbot and Amazon's other crawlers
  2. RFC 9309: Robots Exclusion Protocol
  3. Chrome UX Report top 1,000 origins (global), August 2026

Rather have an expert do it?

Tell us about your site and goals, and we'll match you with an AI visibility (GEO) specialist. Free, no obligation.