WRTN

1 crawler operated by WRTN

https://wrtn.ai/

Who WRTN is, for site owners

WRTN operates 1 crawler in our directory, filed under AI & LLM Bots. Its crawl behaviour is rated safe.

Blocking WRTN carries an SEO impact score of 2/10. Blocking impact is rated: Low - No SEO ranking impact.

Our recommendation for WRTN: Generally safe to allow; provides legitimate crawling value.

WRTN at a glance

OperatorWRTN
Crawler in directory1
CategoriesAI & LLM Bots
SEO impact if blocked2/10
Crawl behaviour1 rated safe
Websitewrtn.ai

Crawler operated by WRTN

What WRTN's crawlers are for

WRTN runs 1 crawler in our database. Grouped by the job each one does:

  • a training crawler: WRTNBot

The highest-priority token is Tier 2. That puts WRTN among the operators whose crawlers have a direct effect on whether AI answers or search results can include your pages.

How site owners treat WRTN

How often site owners write rules for WRTN's tokens, from our own robots.txt study of the Tranco top 10,000:

WRTN tokens named and blocked in top-site robots.txt files
TokenFiles naming itFiles blocking it
WRTNBot63 (1.1%)Not measured

A WRTN token can be blocked without being named, through a User-agent: * group with Disallow: /, so its blocking share can be higher than its naming share.

All counts come from 5,583 valid files fetched October 20, 2026.

Writing one policy for WRTN

A robots.txt file cannot say "WRTN"; it can only name WRTN's tokens, one group at a time. With a single token, one group is the whole policy.

# One token controls everything WRTN fetches through it
User-agent: WRTNBot
Disallow: /private/
Allow: /
  1. Decide per job, not per company. Training, search and user-triggered fetching have different trade-offs, even from the same operator.
  2. Name every token you mean. A token you leave out follows User-agent: *.
  3. Repeat shared rules. A named group ignores the * group, so copy any Disallow lines you still want it to obey.
  4. Verify from outside. Run the AI search visibility check after any change to see the result for each WRTN token, including firewall refusals.
Test yourself: does User-agent: WRTN block all of WRTN's crawlers?

No. robots.txt matches crawler tokens, not company names. Use the token WRTNBot.

Test yourself: if you block one WRTN token, are the others blocked too?

No. Each token is read separately. Blocking one leaves the rest following whatever group applies to them.

Each WRTN crawler, explained

A one-paragraph brief for every WRTN token in our database, covering what it does, how it treats robots.txt and how often large sites write rules for it:

  • WRTN AI (WRTNBot, Tier 2): a training crawler that collects pages both for training and for search or answers. Rated safe. WRTN AI's operator does not clearly document how it treats robots.txt. Write the WRTN AI rule anyway, then confirm in your logs that its requests stop. 1.1% of top-site robots.txt files name it.

Common mistakes with WRTN's crawlers

The errors we see most often with WRTN's crawlers in the files and firewalls we test:

  1. Assuming that blocking WRTN's crawlers removes you from AI answers. It is a training crawler; AI answers are fed by retrieval and user-triggered crawlers with different tokens.
  2. Blocking WRTN's crawlers with a broad User-agent: * rule that also catches search engines. Name WRTNBot in its own group instead.
  3. Expecting a WRTN's crawlers block to remove content already collected. robots.txt only affects future visits.

All three hide inside a file that looks correct, so check WRTN's crawlers from outside after every change.

What our own data shows about WRTN

Everything below comes from the AI Crawler Check bot database and our two most recent robots.txt scans of the Tranco top 10,000, not from WRTN's marketing. WRTN has one token in our database, so the whole picture fits in one place.

WRTNBot in our records

We first recorded WRTNBot on June 18, 2026. We could not find a page where WRTN names it, so treat the token as reported rather than documented. WRTNBot is outside our tracked token set, but 63 of 5,583 top-site files already name it, which is enough to show owners treat it as a real crawler.

Among the 104 AI and LLM crawlers in our database, WRTNBot sits 85th by priority (Tier 2), level with AddSearchBot, AI2Bot, AI2Bot-DeepResearchEval, aiHitBot. 81 of the 104 share its safe rating. Other operators with a crawler that collects pages both for training and for search or answers: PerplexityBot (Perplexity AI, Tier 1), Andibot (Andi, Tier 2), Bytespider (ByteDance, Tier 2), cohere-ai (Cohere, Tier 2), DeepSeekBot (DeepSeek, Tier 2). A policy for WRTNBot is usually a policy for these too.

A decision record for WRTNBot

Teams that review crawlers once a quarter keep one short entry per token, so anyone can see why a rule exists and when it was last checked. Filled in from our data, the WRTNBot entry reads:

  • Operator and job: WRTN; it collects pages both for training and for search or answers.
  • Priority and behaviour: Tier 2, rated safe, blocking impact low.
  • Suggested starting point: Your licensing call: Disallow to refuse training, Allow to permit it.
  • Enforcement: WRTNBot's operator does not clearly document how it treats robots.txt. Write the WRTNBot rule anyway, then confirm in your logs that its requests stop.
User-agent: WRTNBot
Allow: /

Paste the line into the validator with one of your own URLs before it goes live. Revisit the WRTNBot entry whenever WRTN announces a change, because a Tier 2 crawler affects visibility directly.

Checking WRTNBot on your own site

Because WRTN runs only WRTNBot in our records, one check covers the whole operator. Search your access logs for the string WRTNBot over the last 30 days, note how many requests it made and which paths it asked for, then compare that with what your robots.txt allows. WRTN publishes no page about the crawler that we could find, so judge it by the requests you actually see rather than by its name. A Tier 2 crawler rated safe is worth confirming every month, and our log checker does the counting for you.

How top sites treat WRTN's crawlers

From our robots.txt study of the Tranco top 10,000 (5,583 valid files, fetched October 20, 2026):

None of the tokens for WRTN's crawlers is tracked by name in our study. For scale, 20.1% of top-site files block at least one AI training crawler and 4.3% refuse every unnamed crawler with User-agent: * and Disallow: /, which would catch WRTN's crawlers too.

More questions about WRTN

Will blocking WRTN affect my Google rankings?
Only if one of its tokens is a Google search crawler. None of WRTN's tokens are Googlebot, so classic Google rankings are unaffected.
How quickly does a robots.txt change take effect for WRTN?
Crawlers cache robots.txt, commonly for up to a day. Expect a change to apply within about 24 hours, and confirm it in your logs.
Can I allow WRTN on some sections and block it on others?
Yes. Inside the group for WRTNBot, add Disallow lines for the paths to keep private and Allow lines for exceptions. The longest matching rule wins.
Does blocking WRTN delete content it already collected?
No. robots.txt only controls future visits. For content already collected, check whether WRTN offers a removal or opt-out process.
Is a firewall block better than robots.txt for WRTN?
A firewall enforces the decision, while robots.txt asks politely. Many operators recommend robots.txt because blocking their IPs can stop them reading your rules at all. Use robots.txt first, and add a firewall rule only if requests continue.

A five-minute WRTN review

  1. Confirm the token. Compare the user-agent in your logs with the tokens listed on this page. A close spelling is not the same crawler.
  2. Decide the outcome per crawler. Use the briefs above to choose allow, limit or block for each token.
  3. Write the group. Add or edit one User-agent group per decision and repeat any shared rules inside it.
  4. Publish and wait. Allow about a day for crawlers to fetch the new file.
  5. Confirm the result. Check your logs, then run the website crawlability test to see the outcome from outside, including any firewall layer.

How to block or allow WRTN in robots.txt

This rule covers the single crawler WRTN operates. Add it to the robots.txt file at the root of your domain.

Block WRTN completely
User-agent: WRTNBot Disallow: /
Allow WRTN explicitly
User-agent: WRTNBot Allow: /

These WRTN rules ask; they do not enforce. If a WRTN token ignores them, block it at the server or CDN. Paths are case-sensitive, and each rule matches the token, not the full user-agent string.

Frequently asked questions about WRTN

What crawler does WRTN run?
WRTN operates 1 crawler in our directory: WRTN AI (user-agent WRTNBot).
Should I block WRTN?
Generally safe to allow; provides legitimate crawling value. The SEO impact score for blocking is 2/10, where 10 means blocking costs you the most visibility.
How do I block WRTN in robots.txt?
Add the following to robots.txt at your domain root: User-agent: WRTNBot then Disallow: /.
Does blocking WRTN hurt my search rankings?
Blocking impact is rated: Low - No SEO ranking impact. Google's own ranking crawler is Googlebot, which this operator does not run, so blocking WRTN does not by itself remove you from Google's index. What it can change is whether AI assistants and analytics tools can read your pages.
WhatsApp us