Classify · 1 checks · max 200 tokens · benched 2026-09-16
Z Ai models side by side on "Single message intent": GLM 5.3 Flash scores 10/10; GLM 5.3 Flash is the cheapest answer scoring 8+ at $0.01 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.
System
You are a classifier. Reply with exactly one label and nothing else.
User
Choose the single best intent for the message from this list: cancel_subscription, upgrade_plan, billing_question, technical_issue, other. Reply with only the label. Message: "Hi, my card was charged $49 on the 3rd but my plan page says I'm on the $29 tier. Which one am I actually paying for?"
Rubric for the judge: Exactly the label billing_question with no punctuation or explanation.
Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.
z-ai/glm-5.3
96 in · 6 out (3 reasoning) · 1 words · checks 1/1
billing_question
Judge: Output is exactly 'billing_question' with no punctuation or explanation, perfectly matching the rubric requirements.
z-ai/glm-5.2
96 in · 177 out (173 reasoning) · 1 words · checks 1/1
billing_question
Judge: Output is exactly 'billing_question' with no punctuation or explanation, perfectly matching the rubric requirements.
z-ai/glm-5.3-flash
96 in · 4 out · 1 words · checks 1/1
billing_question
Judge: Output is exactly 'billing_question' with no punctuation or explanation, perfectly matching the rubric requirements.
Classify: Exactly the label billing_question with no punctuation or explanation. The deterministic checks are exact.
If the judge's bar of 8/10 is good enough for you, GLM 5.3 Flash at $0.01 per 1,000 runs. If you need the top score, GLM 5.3 Flash at $0.01 per 1,000 runs.
Run it yourself
Re-run this prompt on Z Ai with your own OpenRouter key, or tweak the wording and see what changes.
More Z Ai prompts
If our calculators helped you cut down on hidden AI wallet leaks, thanks for using them. A tiny fraction of your savings is what keeps our pricing indexes updated daily.
Not sure which AI is cheapest for your use case? Find out in 30 seconds — no signup required.
AI cost intelligence
Join the OverpayingForAI list for pricing updates, cheaper alternatives, and practical buying guidance.
Now tracking 50+ AI tools, models, platforms, subscriptions, coding tools, and automation products.