Bots by company

Amazon bots and crawlers

Amazon operates Alexa and its own AI services, with separate crawlers for product improvement and training, for search and for user-requested fetches.

Amazon bots at a glance

  • Amazon runs 9 bots listed in this directory.
  • They belong to: AI Search Crawlers, AI Assistant Fetchers, Ads and Platform Fetchers, AI Training Crawlers, AI Agents.
  • Each Amazon bot has its own robots.txt token, so each purpose can be allowed or blocked separately.
  • Website: www.amazon.com

Every Amazon bot

BotGroupPurposerobots.txtFor GEO
amazon-kendraAI Search CrawlersAI searchProduct featureOfficial docsYesYour choice
amazon-QBusinessAI Assistant FetchersAI assistantReportedNot documentedYour choice
AmazonAdBotAds and Platform FetchersAdsReportedNot documentedAllow
AmazonbotAI Training CrawlersAI trainingSearch indexOfficial docsYesYour choice
AmazonBuyForMeAI AgentsAI agentReportedNot documentedYour choice
Amzn-SearchBotAI Search CrawlersAI searchOfficial docsYesAllow
Amzn-UserAI Assistant FetchersAI assistantOfficial docsNot for user-requested fetchesAllow
bedrockbotAI Search CrawlersAI searchProduct featureOfficial docsYesYour choice
NovaActAI AgentsAI agentReportedNot documentedYour choice

Block or allow all Amazon bots

The rules below name every Amazon token in this directory. To block training but keep AI search, delete the search and assistant tokens from the block rule.

robots.txt: block

# Block all Amazon bots
User-agent: amazon-kendra
User-agent: amazon-QBusiness
User-agent: AmazonAdBot
User-agent: Amazonbot
User-agent: AmazonBuyForMe
User-agent: Amzn-SearchBot
User-agent: Amzn-User
User-agent: bedrockbot
User-agent: NovaAct
Disallow: /

robots.txt: allow

# Allow all Amazon bots
User-agent: amazon-kendra
User-agent: amazon-QBusiness
User-agent: AmazonAdBot
User-agent: Amazonbot
User-agent: AmazonBuyForMe
User-agent: Amzn-SearchBot
User-agent: Amzn-User
User-agent: bedrockbot
User-agent: NovaAct
Allow: /

robots.txt: partial

# Keep all Amazon bots out of private areas only
User-agent: amazon-kendra
User-agent: amazon-QBusiness
User-agent: AmazonAdBot
User-agent: Amazonbot
User-agent: AmazonBuyForMe
User-agent: Amzn-SearchBot
User-agent: Amzn-User
User-agent: bedrockbot
User-agent: NovaAct
Disallow: /wp-admin/
Disallow: /cart/
Disallow: /checkout/
Disallow: /my-account/
Allow: /

Nginx

# Nginx: return 403 to all Amazon bots
if ($http_user_agent ~* "(amazon\-kendra|amazon\-QBusiness|AmazonAdBot|Amazonbot|AmazonBuyForMe|Amzn\-SearchBot|Amzn\-User|bedrockbot|NovaAct)") {
    return 403;
}

Apache

# Apache .htaccess: return 403 to all Amazon bots
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} (amazon\-kendra|amazon\-QBusiness|AmazonAdBot|Amazonbot|AmazonBuyForMe|Amzn\-SearchBot|Amzn\-User|bedrockbot|NovaAct) [NC]
RewriteRule .* - [F,L]

Cloudflare WAF

# Cloudflare > Security > WAF > Custom rule, action: Block
(http.user_agent contains "amazon-kendra") or (http.user_agent contains "amazon-QBusiness") or (http.user_agent contains "AmazonAdBot") or (http.user_agent contains "Amazonbot") or (http.user_agent contains "AmazonBuyForMe") or (http.user_agent contains "Amzn-SearchBot") or (http.user_agent contains "Amzn-User") or (http.user_agent contains "bedrockbot") or (http.user_agent contains "NovaAct")

See which of these bots actually reach your website

The AI Log File Analyzer by Justin Hà counts visits from GPTBot, ClaudeBot, PerplexityBot and other AI crawlers in your server log, for free. The GEO Technical Package sets up robots.txt, llms.txt and crawler access for AI search.

Zalo logo Chat Zalo WhatsApp logo Chat WhatsApp