Bot Operators
103 companies and organizations that operate web crawlers.
All 103 bot operators, ordered by number of bots operated
- Yandex 39 bots https://yandex.com/
- Google 32 bots https://developers.google.com/
- Baidu 10 bots https://www.baidu.com/
- Amazon 8 bots https://www.amazon.com/
- OpenAI 6 bots https://openai.com/
- Anthropic 6 bots https://anthropic.com
- Microsoft 6 bots https://www.bing.com/
- Meta 6 bots https://www.facebook.com/
- ByteDance 4 bots https://www.bytedance.com/
- Mistral AI 3 bots https://mistral.ai/
- Awario 3 bots
- Semrush 3 bots https://www.semrush.com/
- Moonshot AI 3 bots https://www.moonshot.ai/
- Allen Institute for AI 2 bots https://allenai.org/
- DuckDuckGo 2 bots https://duckduckgo.com/
- Huawei 2 bots https://www.huawei.com/
- Perplexity AI 2 bots https://www.perplexity.ai/
- Apple 2 bots https://www.apple.com/
- Mojeek 2 bots
- Ahrefs 2 bots https://ahrefs.com/
- Moz 2 bots https://moz.com/
- Slack 2 bots https://slack.com/
- Diffbot 2 bots
- Open Source 2 bots
- YaCy Community 2 bots
- Internet Archive 2 bots
- Parallel 2 bots
- Exa 2 bots https://exa.ai/
- SB Intuitions 2 bots https://www.sbintuitions.co.jp/
- Kagi 2 bots https://kagi.com/
- Cohere 2 bots
- xAI 2 bots https://x.ai/
- iAsk 2 bots https://iask.ai/
- Alibaba 2 bots
- Unattributed 1 bot
- Open Source Community 1 bot
- Seznam 1 bot https://www.seznam.cz/
- Brandwatch 1 bot
- DataForSEO 1 bot https://dataforseo.com/
- Majestic 1 bot https://majestic.com/
- Neticle 1 bot https://neticle.com/
- Screaming Frog 1 bot https://www.screamingfrog.co.uk/
- LinkedIn 1 bot https://linkedin.com
- Pinterest 1 bot https://www.pinterest.com/
- Babbar 1 bot
- Common Crawl 1 bot https://commoncrawl.org/
- Firecrawl 1 bot https://www.firecrawl.dev/
- ICC 1 bot
- Seekport 1 bot
- Turnitin 1 bot https://www.turnitin.com/
- Velen 1 bot
- Alibaba Cloud 1 bot https://www.alibabacloud.com/
- Hive 1 bot
- X (Twitter) 1 bot
- Bright Data 1 bot
- Klaviyo 1 bot https://www.klaviyo.com/
- LINER 1 bot https://liner.com/
- Arquivo.pt 1 bot
- ROIS-DS 1 bot
- Webz.io 1 bot
- Yahoo 1 bot
- AddSearch 1 bot https://www.addsearch.com/
- aiHit 1 bot https://www.aihitdata.com/
- Andi 1 bot https://andisearch.com/
- Atlassian 1 bot
- Brave 1 bot https://brave.com/
- Zhipu AI 1 bot https://www.zhipuai.cn/
- Cloudflare 1 bot https://www.cloudflare.com/
- Anysphere 1 bot
- DeepSeek 1 bot
- Cognition AI 1 bot https://cognition.ai/
- Manus 1 bot https://manus.im/
- OpenCode 1 bot
- Phind 1 bot https://www.phind.com/
- QuillBot 1 bot https://quillbot.com/
- Tavily 1 bot https://tavily.com/
- WRTN 1 bot https://wrtn.ai/
- You 1 bot
- LAION 1 bot https://laion.ai/
- Lyrenth 1 bot https://lyrenth.com/
- Linkup 1 bot https://www.linkup.so/
- Mozilla 1 bot https://www.mozilla.org/
- Ceramic AI 1 bot https://ceramic.ai/
- Apify 1 bot
- Dealfront 1 bot
- Echobox 1 bot
- FactSet 1 bot
- Ibou 1 bot
- ISS 1 bot
- Panscient 1 bot
- Qualified 1 bot
- Quora 1 bot
- Sidetrade 1 bot
- Timpi 1 bot
- WebMeUp 1 bot
- MyCentral AI 1 bot
- Crawlspace 1 bot
- Dassault Systemes (Netvibes) 1 bot
- FriendlyCrawler 1 bot
- Kangaroo 1 bot
- MauiBot 1 bot
- netEstate 1 bot
- Poseidon Research 1 bot