AI Crawler Check
Free Bot Analysis Tool

Other Agents Directory

Miscellaneous crawlers not fitting other categories.

6 total
2 safe
4 caution
0 aggressive

TurnitinBot

Safe
User-agent: TurnitinBot
Operator: Turnitin

ViennaTinyBot

Safe
User-agent: ViennaTinyBot
Operator: Unknown

archive.org_bot

Caution
User-agent: archive.org_bot
Operator: Internet Archive

ia_archiver

Caution
User-agent: ia_archiver
Operator: Internet Archive

ia_archiver-web.archive.org

Caution
User-agent: ia_archiver-web.archive.org
Operator: Internet Archive

peer39_crawler/1.0

Caution
User-agent: peer39_crawler
Operator: Unknown

FAQ

How many Other Agents are tracked?
We currently track 6 Other Agents with user-agent strings, safety ratings, and blocking rules.
Which Other Agents should I never block?
Never block bots with 'critical' impact rating — there are 0 in this category. Blocking them removes your site from their search results.
Are all Other Agents safe?
Out of 6 bots in this category: 2 safe, 4 caution, 0 aggressive.
How do I block all Other Agents at once?
Generate a combined robots.txt block rule for all Other Agents using our bulk robots.txt generator, or manually list each User-agent + Disallow: / directive.