archive.org_bot
CautionUser-agent: archive.org_bot
Operator: Internet Archive
Added:
Other Agents Directory
Miscellaneous crawlers not fitting other categories.
4 tokens
2 safe
2 caution
0 aggressive
All 4 Other Agents
Arquivo.pt Web Archive
SafeUser-agent:
Arquivo-web-crawlerOperator: Arquivo.pt
Added:
ia_archiver
CautionUser-agent:
ia_archiverOperator: Internet Archive
Added:
TurnitinBot
SafeUser-agent:
TurnitinBotOperator: Turnitin
Added:
No bots match those filters. Try a shorter search or browse every category. Missing a crawler? Tell us and we will research it.
FAQ
How many Other Agents are tracked?
We currently track 4 Other Agents with user-agent strings, safety ratings, and blocking rules.
Which Other Agents should I never block?
Never block bots with 'critical' impact rating - there are 0 in this category. Blocking them removes your site from their search results.
Are all Other Agents safe?
Out of 4 bots in this category: 2 safe, 2 caution, 0 aggressive.
How do I block all Other Agents at once?
Generate a combined robots.txt block rule for all Other Agents using our bulk robots.txt generator, or manually list each User-agent + Disallow: / directive.