Rewrite · 4 checks · max 400 tokens · benched 2026-09-16

Qwen3.8 Max (0902) vs Qwen3.8 27B vs Qwen3.8 Flash vs Qwen3.7 Plus on product update to a 280-character post

Alibaba models side by side on "Product update to a 280-character post": Qwen3.8 Flash scores 9/10; Qwen3.8 Flash is the cheapest answer scoring 8+ at $0.12 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.

The prompt every model received

User

Turn this update into a single social media post of at most 280 characters. It must mention "v2.0" and end with the hashtag #OpenSource. Output only the post.

Update: Version 2.0 of our command-line tool is out. It is three times faster on large repositories, adds a built-in diff viewer, and is now licensed under MIT so anyone can contribute.

Rubric for the judge: Punchy post under 280 characters that mentions v2.0, the speed gain, the diff viewer and MIT, ending with #OpenSource.

Side by side

Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.

Qwen3.8 Max (0902)

qwen/qwen3.8-max-0902

9/10

Latency: 1.5s
Cost: $0.00166
Per 1,000: $1.66

133 in · 232 out (189 reasoning) · 24 words · checks 4/4

max_chars
contains
regex
contains

v2.0 of our CLI tool is here! 🚀 3x faster on large repos, built-in diff viewer, and now MIT-licensed so anyone can contribute. #OpenSource

Judge: Post is 119 characters (well under 280), mentions v2.0, speed gain, diff viewer, and MIT licensing, ends with #OpenSource hashtag as required; only minor issue is slight rewording of 'command-line tool' to 'CLI tool' but this is acceptable and makes it punchier.

Qwen3.8 27B

qwen/qwen3.8-27b

9/10

Latency: 407ms
Cost: $0.00077
Per 1,000: $0.77

124 in · 293 out (170 reasoning) · 21 words · checks 4/4

max_chars
contains
regex
contains



v2.0 is here! ⚡ 3x faster on large repos, built-in diff viewer, and now MIT licensed so anyone can contribute. #OpenSource

Judge: Post is 119 characters, mentions v2.0, speed gain, diff viewer, MIT licensing, and ends with #OpenSource as required; only minor issue is not explicitly stating 'anyone can contribute' though it's implied by 'MIT licensed so anyone can contribute.'

Qwen3.8 Flash

qwen/qwen3.8-flash

9/10

top judge scorecheapest scoring 8+

Latency: 867ms
Cost: $0.00012
Per 1,000: $0.12

145 in · 208 out (168 reasoning) · 22 words · checks 4/4

max_chars
contains
regex
contains

v2.0 of our command-line tool is out: 3x faster on large repos, built-in diff viewer, and MIT-licensed so anyone can contribute. #OpenSource

Judge: Post is 127 characters, mentions v2.0, speed gain, diff viewer, MIT licensing, and ends with #OpenSource as required; only minor issue is it doesn't explicitly state 'anyone can contribute' though 'so anyone can contribute' is implied by MIT-licensed context.

Qwen3.7 Plus

qwen/qwen3.7-plus

9/10

Latency: 1.8s
Cost: $0.00131
Per 1,000: $1.31

94 in · 1004 out (949 reasoning) · 36 words · checks 4/4

max_chars
contains
regex
contains

🚀 v2.0 of our CLI tool is out! It's 3x faster on large repos, adds a built-in diff viewer, and is now MIT licensed so anyone can contribute. Grab the latest release and start building! #OpenSource

Judge: Post is 278 characters, mentions v2.0, speed gain (3x faster), diff viewer, and MIT licensing, ends with #OpenSource as required; only minor issue is the extra 'Grab the latest release and start building!' adds slight fluff beyond the rubric requirements.

Frequently asked

What does this prompt test?

Rewrite: Punchy post under 280 characters that mentions v2.0, the speed gain, the diff viewer and MIT, ending with #OpenSource. The deterministic checks are max_chars, contains, regex, contains.

Which model should I pick for this task?

If the judge's bar of 8/10 is good enough for you, Qwen3.8 Flash at $0.12 per 1,000 runs. If you need the top score, Qwen3.8 Flash at $0.12 per 1,000 runs.

Same prompt, other families

Run it yourself

Re-run this prompt on Alibaba with your own OpenRouter key, or tweak the wording and see what changes.

Side by side

Qwen3.8 Max (0902)

Qwen3.8 27B

Qwen3.8 Flash

Qwen3.7 Plus

Frequently asked

Same prompt, other families

Stop overpaying for AI tools