Cotoyogi (ROIS-DS)
SafeUser-agent: Cotoyogi
Category: Scrapers
SEO impact if blocked: 2/10
1 crawler operated by ROIS-DS
ROIS-DS operates 1 crawler in our directory, filed under Scrapers. Its crawl behaviour is rated safe.
Blocking ROIS-DS carries an SEO impact score of 2/10. Blocking impact is rated: Low - No SEO ranking impact.
Our recommendation for ROIS-DS: Generally safe to allow; provides legitimate crawling value.
| Operator | ROIS-DS |
|---|---|
| Crawler in directory | 1 |
| Categories | Scrapers |
| SEO impact if blocked | 2/10 |
| Crawl behaviour | 1 rated safe |
| Official crawler docs | ROIS-DS crawler documentation |
ROIS-DS runs 1 crawler in our database. Grouped by the job each one does:
CotoyogiThe highest-priority token is Tier 6. That makes ROIS-DS a lower-priority operator for most sites: worth a deliberate decision, but rarely the one that decides your visibility.
None of ROIS-DS's tokens were among the names tracked in our robots.txt study of the Tranco top 10,000, which usually means few large sites write rules for them yet. Your own logs are the best evidence of how often they visit.
A robots.txt file cannot say "ROIS-DS"; it can only name ROIS-DS's tokens, one group at a time. With a single token, one group is the whole policy.
# One token controls everything ROIS-DS fetches through it
User-agent: Cotoyogi
Disallow: /private/
Allow: /
User-agent: *.* group, so copy any Disallow lines you still want it to obey.User-agent: ROIS-DS block all of ROIS-DS's crawlers?No. robots.txt matches crawler tokens, not company names. Use the token Cotoyogi.
No. Each token is read separately. Blocking one leaves the rest following whatever group applies to them.
A one-paragraph brief for every ROIS-DS token in our database, covering what it does, how it treats robots.txt and how often large sites write rules for it:
Cotoyogi, Tier 6): a training crawler that collects pages to train AI models. Rated safe. Cotoyogi (ROIS-DS)'s operator does not clearly document how it treats robots.txt. Write the Cotoyogi (ROIS-DS) rule anyway, then confirm in your logs that its requests stop. Not tracked in our robots.txt study.The errors we see most often with ROIS-DS's crawlers in the files and firewalls we test:
User-agent: * rule that also catches search engines. Name Cotoyogi in its own group instead.All three hide inside a file that looks correct, so check ROIS-DS's crawlers from outside after every change.
Everything below comes from the AI Crawler Check bot database and our two most recent robots.txt scans of the Tranco top 10,000, not from ROIS-DS's marketing. ROIS-DS has one token in our database, so the whole picture fits in one place.
Cotoyogi in our recordsWe first recorded Cotoyogi on March 17, 2026. ROIS-DS documents it on ds.rois.ac.jp, and we recheck that page before each release. No file in our top-10,000 scans names Cotoyogi, so any rule you write for it puts you ahead of almost every large site.
Among the 39 data scrapers in our database, Cotoyogi sits tenth by priority (Tier 6), level with Amazon Kendra, ApifyBot, Barkrowler, BLEXBot. 29 of the 39 share its safe rating. Other operators with a crawler that collects pages to train AI models: ClaudeBot (Anthropic, Tier 1), Google-Extended (Google, Tier 1), GPTBot (OpenAI, Tier 1), Meta-ExternalAgent (Meta, Tier 1), AI2Bot (Allen Institute for AI, Tier 2). A policy for Cotoyogi is usually a policy for these too.
CotoyogiTeams that review crawlers once a quarter keep one short entry per token, so anyone can see why a rule exists and when it was last checked. Filled in from our data, the Cotoyogi entry reads:
User-agent: Cotoyogi
Allow: /
Paste the line into the validator with one of your own URLs before it goes live. Revisit the Cotoyogi entry once a quarter, or when ROIS-DS publishes a new token next to it.
Cotoyogi on your own siteBecause ROIS-DS runs only Cotoyogi in our records, one check covers the whole operator. Search your access logs for the string Cotoyogi over the last 30 days, note how many requests it made and which paths it asked for, then compare that with what your robots.txt allows. Match the requests against what ROIS-DS publishes about the crawler, since that page is the only authority on its behaviour. A Tier 6 crawler rated safe rarely needs more than a quarterly look, and our log checker does the counting for you.
From our robots.txt study of the Tranco top 10,000 (5,583 valid files, fetched October 20, 2026):
None of the tokens for ROIS-DS's crawlers is tracked by name in our study. For scale, 20.1% of top-site files block at least one AI training crawler and 4.3% refuse every unnamed crawler with User-agent: * and Disallow: /, which would catch ROIS-DS's crawlers too.
Cotoyogi, add Disallow lines for the paths to keep private and Allow lines for exceptions. The longest matching rule wins.User-agent group per decision and repeat any shared rules inside it.This rule covers the single crawler ROIS-DS operates. Add it to the robots.txt file at the root of your domain.
These ROIS-DS rules ask; they do not enforce. If a ROIS-DS token ignores them, block it at the server or CDN. Paths are case-sensitive, and each rule matches the token, not the full user-agent string.
Text size
Saved on this device only. Drag the round button to move it. Accessibility statement