Kagibot

A representative user-agent string. Version numbers change; the Kagibot token does not. Paste your own log line into the user-agent checker to confirm a match.

Add this to the robots.txt at the root of your domain. Robots.txt is advisory: it works only on crawlers that choose to read it. This one is honours robots.txt according to its operator.

To block every ai search indexer at once, or to block training while keeping AI search citations, use the robots.txt generator.

A more specific User-agent group wins over a wildcard. Place this above any User-agent: * block that disallows paths, and Kagibot keeps full access.

The user-agent string is self-asserted: anyone can send it from a laptop, and scrapers routinely impersonate well-known crawlers to slip past filters aimed at unknown ones.

Kagi publishes the IP addresses its crawler uses.