Code fix · 3 checks · max 600 tokens · benched 2026-09-16
Z Ai models side by side on "Fix a missing await in JavaScript": GLM 5.3 Flash scores 10/10; GLM 5.3 Flash is the cheapest answer scoring 8+ at $0.01 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.
System
You are a senior engineer. Reply with code only unless asked otherwise.
User
getName() always returns undefined. fetchUser(id) returns a Promise that resolves to an object with a name property. Fix the bug and return the complete corrected function only, keeping the same function name and signature.
async function getName(id) {
const user = fetchUser(id);
return user.name;
}Rubric for the judge: Adds await to fetchUser, keeps the async signature, returns the name; no unrelated rewrites.
Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.
z-ai/glm-5.3
89 in · 30 out (3 reasoning) · 14 words · checks 3/3
```javascript
async function getName(id) {
const user = await fetchUser(id);
return user.name;
}
```Judge: Output correctly adds await to resolve the Promise, maintains async function signature, returns user.name, and provides only the corrected function without extra commentary.
z-ai/glm-5.2
89 in · 36 out (9 reasoning) · 14 words · checks 3/3
```javascript
async function getName(id) {
const user = await fetchUser(id);
return user.name;
}
```Judge: Output correctly adds await to resolve the Promise, maintains async function signature, returns user.name, and provides only the corrected function without extra commentary.
z-ai/glm-5.3-flash
89 in · 27 out · 14 words · checks 3/3
```javascript
async function getName(id) {
const user = await fetchUser(id);
return user.name;
}
```Judge: Output correctly adds await to resolve the Promise, maintains async function signature, returns user.name, and provides only the corrected function without extra commentary.
Code fix: Adds await to fetchUser, keeps the async signature, returns the name; no unrelated rewrites. The deterministic checks are contains, regex, contains.
If the judge's bar of 8/10 is good enough for you, GLM 5.3 Flash at $0.01 per 1,000 runs. If you need the top score, GLM 5.3 Flash at $0.01 per 1,000 runs.
Run it yourself
Re-run this prompt on Z Ai with your own OpenRouter key, or tweak the wording and see what changes.
More Z Ai prompts
If our calculators helped you cut down on hidden AI wallet leaks, thanks for using them. A tiny fraction of your savings is what keeps our pricing indexes updated daily.
Not sure which AI is cheapest for your use case? Find out in 30 seconds — no signup required.
AI cost intelligence
Join the OverpayingForAI list for pricing updates, cheaper alternatives, and practical buying guidance.
Now tracking 50+ AI tools, models, platforms, subscriptions, coding tools, and automation products.