Twitterbot
SafeUser-agent: Twitterbot
Category: Social Media Bots
SEO impact if blocked: 0/10
X (Twitter)
1 crawler operated by X (Twitter)
Who X (Twitter) is, for site owners
X (Twitter) operates 1 crawler in our directory, filed under Social Media Bots. Its crawl behaviour is rated safe.
Blocking X (Twitter) carries an SEO impact score of 0/10. Blocking impact is rated: Varies - Evaluate before blocking.
Our recommendation for X (Twitter): Generally safe to allow; provides legitimate crawling value.
X (Twitter) at a glance
| Operator | X (Twitter) |
|---|---|
| Crawler in directory | 1 |
| Categories | Social Media Bots |
| SEO impact if blocked | 0/10 |
| Crawl behaviour | 1 rated safe |
| Official crawler docs | X (Twitter) crawler documentation |
Crawler operated by X (Twitter)
How to block or allow X (Twitter) in robots.txt
This rule covers the single crawler X (Twitter) operates. Add it to the robots.txt file at the root of your domain.
Block X (Twitter) completely
User-agent: Twitterbot
Disallow: /
Allow X (Twitter) explicitly
User-agent: Twitterbot
Allow: /
robots.txt is a request, not an enforcement mechanism. A crawler that ignores it needs a block at the server or CDN layer. Rules are case-sensitive on the path and matched against the user-agent token, not the full user-agent string.
Frequently asked questions about X (Twitter)
What crawler does X (Twitter) run?
X (Twitter) operates 1 crawler in our directory: Twitterbot (user-agent Twitterbot).
Should I block X (Twitter)?
Generally safe to allow; provides legitimate crawling value. The SEO impact score for blocking is 0/10, where 10 means blocking costs you the most visibility.
How do I block X (Twitter) in robots.txt?
Add the following to robots.txt at your domain root: User-agent: Twitterbot then Disallow: /.
Does blocking X (Twitter) hurt my search rankings?
Blocking impact is rated: Varies - Evaluate before blocking. Google's own ranking crawler is Googlebot, which this operator does not run, so blocking X (Twitter) does not by itself remove you from Google's index. What it can change is whether AI assistants and analytics tools can read your pages.