Operated by Amazon
AWS Bedrock Bot is an AI data-collection crawler operated by Amazon. It gathers public web content to build or refine training datasets for large language models. Like other AI training crawlers, AWS Bedrock Bot does not influence your search-engine rankings, so you can block it via robots.txt without any SEO penalty if you wish to opt out of AI training.
AWS Bedrock Bot is an AI data-collection crawler operated by Amazon. It gathers public web content to build or refine training datasets for large language models. Like other AI training crawlers, AWS Bedrock Bot does not influence your search-engine rankings, so you can block it via robots.txt without any SEO penalty if you wish to opt out of AI training.
AWS Bedrock Bot uses the user-agent token bedrockbot. You can control it via robots.txt, meta tags (noai), or the emerging llms.txt standard. Robots.txt is voluntary; for hard enforcement, combine it with server-level IP blocking.
User-agent / Disallow: / without any SEO penalty.<code>User-agent: bedrockbot</code> — Matching is case-insensitive. Robots.txt is fetched from the root of each subdomain separately.
Understanding AWS Bedrock Bot's purpose helps you decide whether to allow or block it.
bedrockbot. Use this exact string in robots.txt, Nginx, Apache, or Cloudflare firewall rules to target this bot. Matching in robots.txt is case-insensitive. Verify a request genuinely comes from AWS Bedrock Bot by performing a reverse-DNS lookup on the source IP.User-agent / Disallow: / without any SEO penalty./robots.txt file:
User-agent: bedrockbot Disallow: /This instructs AWS Bedrock Bot not to crawl any path on your site. To block only specific sections, replace / with the path (e.g.,
Disallow: /blog/)./robots.txt before crawling, following RFC 9309. For hard enforcement, combine robots.txt with server-level IP or user-agent blocking.bedrockbot (case-insensitive: grep -i "bedrockbot" /var/log/nginx/access.log). Filter by user-agent in your log analytics tool (GoAccess, AWStats, etc.).Check instantly with our free AI Bot Checker
Check Your Website