Arquivo.pt Web Archive
SafeUser-agent: Arquivo-web-crawler
Category: Other Agents
SEO impact if blocked: 2/10
1 crawler operated by Arquivo.pt
Arquivo.pt operates 1 crawler in our directory, filed under Other Agents. Its crawl behaviour is rated safe.
Blocking Arquivo.pt carries an SEO impact score of 2/10. Blocking impact is rated: Low - No SEO ranking impact.
Our recommendation for Arquivo.pt: Generally safe to allow; provides legitimate crawling value.
| Operator | Arquivo.pt |
|---|---|
| Crawler in directory | 1 |
| Categories | Other Agents |
| SEO impact if blocked | 2/10 |
| Crawl behaviour | 1 rated safe |
| Official crawler docs | Arquivo.pt crawler documentation |
This rule covers the single crawler Arquivo.pt operates. Add it to the robots.txt file at the root of your domain.
robots.txt is a request, not an enforcement mechanism. A crawler that ignores it needs a block at the server or CDN layer. Rules are case-sensitive on the path and matched against the user-agent token, not the full user-agent string.