ISSCyberRiskCrawler
SafeUser-agent: ISSCyberRiskCrawler
Category: Scrapers
SEO impact if blocked: 2/10
1 crawler operated by ISS
ISS operates 1 crawler in our directory, filed under Scrapers. Its crawl behaviour is rated safe.
Blocking ISS carries an SEO impact score of 2/10. Blocking impact is rated: Low - No SEO ranking impact.
Our recommendation for ISS: Generally safe to allow; provides legitimate crawling value.
| Operator | ISS |
|---|---|
| Crawler in directory | 1 |
| Categories | Scrapers |
| SEO impact if blocked | 2/10 |
| Crawl behaviour | 1 rated safe |
ISS runs 1 crawler in our database. Grouped by the job each one does:
ISSCyberRiskCrawlerThe highest-priority token is Tier 6. That makes ISS a lower-priority operator for most sites: worth a deliberate decision, but rarely the one that decides your visibility.
How often site owners write rules for ISS's tokens, from our own robots.txt study of the Tranco top 10,000:
| Token | Files naming it | Files blocking it |
|---|---|---|
ISSCyberRiskCrawler | 107 (1.9%) | Not measured |
A ISS token can be blocked without being named, through a User-agent: * group with Disallow: /, so its blocking share can be higher than its naming share.
All counts come from 5,583 valid files fetched October 20, 2026.
A robots.txt file cannot say "ISS"; it can only name ISS's tokens, one group at a time. With a single token, one group is the whole policy.
# One token controls everything ISS fetches through it
User-agent: ISSCyberRiskCrawler
Disallow: /private/
Allow: /
User-agent: *.* group, so copy any Disallow lines you still want it to obey.User-agent: ISS block all of ISS's crawlers?No. robots.txt matches crawler tokens, not company names. Use the token ISSCyberRiskCrawler.
No. Each token is read separately. Blocking one leaves the rest following whatever group applies to them.
A one-paragraph brief for every ISS token in our database, covering what it does, how it treats robots.txt and how often large sites write rules for it:
ISSCyberRiskCrawler, Tier 6): a utility crawler that harvests pages for a dataset or data product. Rated safe. ISSCyberRiskCrawler's operator does not clearly document how it treats robots.txt. Write the ISSCyberRiskCrawler rule anyway, then confirm in your logs that its requests stop. 1.9% of top-site robots.txt files name it.The errors we see most often with ISS's crawlers in the files and firewalls we test:
All three hide inside a file that looks correct, so check ISS's crawlers from outside after every change.
Everything below comes from the AI Crawler Check bot database and our two most recent robots.txt scans of the Tranco top 10,000, not from ISS's marketing. ISS has one token in our database, so the whole picture fits in one place.
ISSCyberRiskCrawler in our recordsWe first recorded ISSCyberRiskCrawler on March 17, 2026. We could not find a page where ISS names it, so treat the token as reported rather than documented. ISSCyberRiskCrawler is outside our tracked token set, but 107 of 5,583 top-site files already name it, which is enough to show owners treat it as a real crawler.
Among the 39 data scrapers in our database, ISSCyberRiskCrawler sits 22th by priority (Tier 6), level with Amazon Kendra, ApifyBot, Barkrowler, BLEXBot. 29 of the 39 share its safe rating. Other operators with a crawler that harvests pages for a dataset or data product: FirecrawlAgent (Firecrawl, Tier 2), iaskspider (iAsk, Tier 2), NovaAct (Amazon, Tier 2), CloudflareBrowserRenderingCrawler (Cloudflare, Tier 3), Amazon Kendra (Amazon, Tier 6). A policy for ISSCyberRiskCrawler is usually a policy for these too.
ISSCyberRiskCrawlerTeams that review crawlers once a quarter keep one short entry per token, so anyone can see why a rule exists and when it was last checked. Filled in from our data, the ISSCyberRiskCrawler entry reads:
User-agent: ISSCyberRiskCrawler
Allow: /
Paste the line into the validator with one of your own URLs before it goes live. Revisit the ISSCyberRiskCrawler entry once a quarter, or when ISS publishes a new token next to it.
ISSCyberRiskCrawler on your own siteBecause ISS runs only ISSCyberRiskCrawler in our records, one check covers the whole operator. Search your access logs for the string ISSCyberRiskCrawler over the last 30 days, note how many requests it made and which paths it asked for, then compare that with what your robots.txt allows. ISS publishes no page about the crawler that we could find, so judge it by the requests you actually see rather than by its name. A Tier 6 crawler rated safe rarely needs more than a quarterly look, and our log checker does the counting for you.
From our robots.txt study of the Tranco top 10,000 (5,583 valid files, fetched October 20, 2026):
None of the tokens for ISS's crawlers is tracked by name in our study. For scale, 20.1% of top-site files block at least one AI training crawler and 4.3% refuse every unnamed crawler with User-agent: * and Disallow: /, which would catch ISS's crawlers too.
ISSCyberRiskCrawler, add Disallow lines for the paths to keep private and Allow lines for exceptions. The longest matching rule wins.User-agent group per decision and repeat any shared rules inside it.This rule covers the single crawler ISS operates. Add it to the robots.txt file at the root of your domain.
These ISS rules ask; they do not enforce. If a ISS token ignores them, block it at the server or CDN. Paths are case-sensitive, and each rule matches the token, not the full user-agent string.
Text size
Saved on this device only. Drag the round button to move it. Accessibility statement