Parallel Fetcher
SafeUser-agent: Shap-User
Category: AI & LLM Bots
SEO impact if blocked: 2/10
2 crawlers operated by Parallel
Parallel operates 2 crawlers in our directory, filed under AI & LLM Bots. Of those 2, 1 rated safe, 1 rated caution for crawl behaviour.
Blocking Parallel carries an SEO impact score of 2/10 across its crawlers. Every crawler here carries the same blocking impact: Low - No SEO ranking impact.
Our recommendation for Parallel, set by its least reassuring crawler (Parallel Web Crawler, rated caution): Generally safe to allow; provides legitimate crawling value.
| Operator | Parallel |
|---|---|
| Crawlers in directory | 2 |
| Categories | AI & LLM Bots |
| SEO impact if blocked | 2/10 |
| Crawl behaviour | 1 rated safe, 1 rated caution |
| Official crawler docs | Parallel crawler documentation |
These rules cover all 2 crawlers Parallel operates. Add them to the robots.txt file at the root of your domain.
robots.txt is a request, not an enforcement mechanism. A crawler that ignores it needs a block at the server or CDN layer. Rules are case-sensitive on the path and matched against the user-agent token, not the full user-agent string.