Rewrite · 4 checks · max 400 tokens · benched 2026-09-16
DeepSeek models side by side on "Product update to a 280-character post": DeepSeek V4.1 Flash scores 10/10; DeepSeek V4.1 Flash is the cheapest answer scoring 8+ at $0.19 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.
User
Turn this update into a single social media post of at most 280 characters. It must mention "v2.0" and end with the hashtag #OpenSource. Output only the post. Update: Version 2.0 of our command-line tool is out. It is three times faster on large repositories, adds a built-in diff viewer, and is now licensed under MIT so anyone can contribute.
Rubric for the judge: Punchy post under 280 characters that mentions v2.0, the speed gain, the diff viewer and MIT, ending with #OpenSource.
Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.
deepseek/deepseek-v4-pro
87 in · 744 out (710 reasoning) · 20 words · checks 4/4
v2.0 of our CLI tool is here! 3x faster on large repos, built-in diff viewer, and now MIT licensed. #OpenSource
Judge: Post is 108 characters, mentions v2.0, speed gain, diff viewer, and MIT licensing, ends with #OpenSource as required, though it could have been slightly more punchy or emphasized the contribution aspect.
deepseek/deepseek-v4-flash
167 in · 9342 out (9312 reasoning) · 20 words · checks 4/4
v2.0 of our CLI tool is out! 3x faster on large repos, built-in diff viewer, MIT licensed for contributions. #OpenSource
Judge: Post is 109 characters (well under 280), mentions v2.0, speed gain, diff viewer, MIT licensing, and ends with #OpenSource as required; only minor issue is it doesn't explicitly mention 'anyone can contribute' but the MIT licensing reference implies this.
deepseek/deepseek-v4.1-flash
112 in · 282 out (243 reasoning) · 23 words · checks 4/4
Our command-line tool v2.0 is out! 3x faster on large repos, plus a built-in diff viewer. Now MIT-licensed so anyone can contribute. #OpenSource
Judge: Post is 127 characters, mentions v2.0, speed gain (3x faster), diff viewer, MIT licensing, ends with #OpenSource, and is punchy and well-formatted.
Rewrite: Punchy post under 280 characters that mentions v2.0, the speed gain, the diff viewer and MIT, ending with #OpenSource. The deterministic checks are max_chars, contains, regex, contains.
If the judge's bar of 8/10 is good enough for you, DeepSeek V4.1 Flash at $0.19 per 1,000 runs. If you need the top score, DeepSeek V4.1 Flash at $0.19 per 1,000 runs.
Run it yourself
Re-run this prompt on DeepSeek with your own OpenRouter key, or tweak the wording and see what changes.
More DeepSeek prompts
If our calculators helped you cut down on hidden AI wallet leaks, thanks for using them. A tiny fraction of your savings is what keeps our pricing indexes updated daily.
Not sure which AI is cheapest for your use case? Find out in 30 seconds — no signup required.
AI cost intelligence
Join the OverpayingForAI list for pricing updates, cheaper alternatives, and practical buying guidance.
Now tracking 50+ AI tools, models, platforms, subscriptions, coding tools, and automation products.