ChatGLM Spider
CautionUser-agent: ChatGLM-Spider
Category: AI & LLM Bots
SEO impact if blocked: 2/10
1 crawler operated by Zhipu AI
https://www.zhipuai.cn/Zhipu AI operates 1 crawler in our directory, filed under AI & LLM Bots. Its crawl behaviour is rated caution.
Blocking Zhipu AI carries an SEO impact score of 2/10. Blocking impact is rated: Low - No SEO ranking impact.
Our recommendation for Zhipu AI: Generally safe to allow; provides legitimate crawling value.
| Operator | Zhipu AI |
|---|---|
| Crawler in directory | 1 |
| Categories | AI & LLM Bots |
| SEO impact if blocked | 2/10 |
| Crawl behaviour | 1 rated caution |
| Website | www.zhipuai.cn |
Zhipu AI runs 1 crawler in our database. Grouped by the job each one does:
ChatGLM-SpiderThe highest-priority token is Tier 2. That puts Zhipu AI among the operators whose crawlers have a direct effect on whether AI answers or search results can include your pages.
How often site owners write rules for Zhipu AI's tokens, from our own robots.txt study of the Tranco top 10,000:
| Token | Files naming it | Files blocking it |
|---|---|---|
ChatGLM-Spider | 109 (2%) | Not measured |
A Zhipu AI token can be blocked without being named, through a User-agent: * group with Disallow: /, so its blocking share can be higher than its naming share.
All counts come from 5,583 valid files fetched October 20, 2026.
A robots.txt file cannot say "Zhipu AI"; it can only name Zhipu AI's tokens, one group at a time. With a single token, one group is the whole policy.
# One token controls everything Zhipu AI fetches through it
User-agent: ChatGLM-Spider
Disallow: /private/
Allow: /
User-agent: *.* group, so copy any Disallow lines you still want it to obey.User-agent: Zhipu AI block all of Zhipu AI's crawlers?No. robots.txt matches crawler tokens, not company names. Use the token ChatGLM-Spider.
No. Each token is read separately. Blocking one leaves the rest following whatever group applies to them.
A one-paragraph brief for every Zhipu AI token in our database, covering what it does, how it treats robots.txt and how often large sites write rules for it:
ChatGLM-Spider, Tier 2): a training crawler that collects pages to train AI models. Rated caution. ChatGLM Spider's operator does not clearly document how it treats robots.txt. Write the ChatGLM Spider rule anyway, then confirm in your logs that its requests stop. 2% of top-site robots.txt files name it.The errors we see most often with Zhipu AI's crawlers in the files and firewalls we test:
User-agent: * rule that also catches search engines. Name ChatGLM-Spider in its own group instead.All three hide inside a file that looks correct, so check Zhipu AI's crawlers from outside after every change.
Everything below comes from the AI Crawler Check bot database and our two most recent robots.txt scans of the Tranco top 10,000, not from Zhipu AI's marketing. Zhipu AI has one token in our database, so the whole picture fits in one place.
ChatGLM-Spider in our recordsWe first recorded ChatGLM-Spider on June 18, 2026. We could not find a page where Zhipu AI names it, so treat the token as reported rather than documented. ChatGLM-Spider is outside our tracked token set, but 109 of 5,583 top-site files already name it, which is enough to show owners treat it as a real crawler.
Among the 104 AI and LLM crawlers in our database, ChatGLM-Spider sits 28th by priority (Tier 2), level with AddSearchBot, AI2Bot, AI2Bot-DeepResearchEval, aiHitBot. 22 of the 104 share its caution rating. Other operators with a crawler that collects pages to train AI models: ClaudeBot (Anthropic, Tier 1), Google-Extended (Google, Tier 1), GPTBot (OpenAI, Tier 1), Meta-ExternalAgent (Meta, Tier 1), AI2Bot (Allen Institute for AI, Tier 2). A policy for ChatGLM-Spider is usually a policy for these too.
ChatGLM-SpiderTeams that review crawlers once a quarter keep one short entry per token, so anyone can see why a rule exists and when it was last checked. Filled in from our data, the ChatGLM-Spider entry reads:
User-agent: ChatGLM-Spider
Allow: /
Paste the line into the validator with one of your own URLs before it goes live. Revisit the ChatGLM-Spider entry sooner than most: a caution rating means Zhipu AI traffic deserves a monthly look at your logs.
ChatGLM-Spider on your own siteBecause Zhipu AI runs only ChatGLM-Spider in our records, one check covers the whole operator. Search your access logs for the string ChatGLM-Spider over the last 30 days, note how many requests it made and which paths it asked for, then compare that with what your robots.txt allows. Zhipu AI publishes no page about the crawler that we could find, so judge it by the requests you actually see rather than by its name. A Tier 2 crawler rated caution is worth confirming every month, and our log checker does the counting for you.
From our robots.txt study of the Tranco top 10,000 (5,583 valid files, fetched October 20, 2026):
None of the tokens for Zhipu AI's crawlers is tracked by name in our study. For scale, 20.1% of top-site files block at least one AI training crawler and 4.3% refuse every unnamed crawler with User-agent: * and Disallow: /, which would catch Zhipu AI's crawlers too.
ChatGLM-Spider, add Disallow lines for the paths to keep private and Allow lines for exceptions. The longest matching rule wins.User-agent group per decision and repeat any shared rules inside it.This rule covers the single crawler Zhipu AI operates. Add it to the robots.txt file at the root of your domain.
These Zhipu AI rules ask; they do not enforce. If a Zhipu AI token ignores them, block it at the server or CDN. Paths are case-sensitive, and each rule matches the token, not the full user-agent string.
Text size
Saved on this device only. Drag the round button to move it. Accessibility statement