Skip to content

Training · Amazon

Amazonbot

Amazon's web crawler, used to improve Alexa answers and other Amazon services. Amazon documents that it honours robots.txt and standard crawl-delay hints.

Operator
Amazon
Feeds
Alexa
robots.txt token
Amazonbot
Honours robots.txt
Honours robots.txt

What it looks like in server logs

A representative user-agent string. Version numbers change; the Amazonbot token does not. Paste your own log line into the user-agent checker to confirm a match.

user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)

How to block Amazonbot

Add this to the robots.txt at the root of your domain. Robots.txt is advisory: it works only on crawlers that choose to read it. This one is honours robots.txt according to its operator.

robots.txt
User-agent: Amazonbot
Disallow: /

To block every training crawler at once, or to block training while keeping AI search citations, use the robots.txt generator.

How to allow Amazonbot while blocking others

A more specific User-agent group wins over a wildcard. Place this above any User-agent: * block that disallows paths, and Amazonbot keeps full access.

robots.txt
User-agent: Amazonbot
Allow: /

How to verify a genuine hit

The user-agent string is self-asserted: anyone can send it from a laptop, and scrapers routinely impersonate well-known crawlers to slip past filters aimed at unknown ones.

Reverse DNS of a genuine hit resolves to *.crawl.amazonbot.amazon.