Rewrite · 4 checks · max 400 tokens · benched 2026-09-16

MiniMax M3 vs MiniMax M2.7 vs MiniMax M2.5 on product update to a 280-character post

Minimax models side by side on "Product update to a 280-character post": MiniMax M3 scores 9/10; MiniMax M3 is the cheapest answer scoring 8+ at $0.36 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.

The prompt every model received

User

Turn this update into a single social media post of at most 280 characters. It must mention "v2.0" and end with the hashtag #OpenSource. Output only the post.

Update: Version 2.0 of our command-line tool is out. It is three times faster on large repositories, adds a built-in diff viewer, and is now licensed under MIT so anyone can contribute.

Rubric for the judge: Punchy post under 280 characters that mentions v2.0, the speed gain, the diff viewer and MIT, ending with #OpenSource.

Side by side

Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.

MiniMax M3

minimax/minimax-m3

9/10

top judge scorecheapest scoring 8+

Latency: 1.6s
Cost: $0.00036
Per 1,000: $0.36

257 in · 258 out (220 reasoning) · 24 words · checks 4/4

max_chars
contains
regex
contains

Just released v2.0 of our CLI tool! 🚀 3x faster on large repos, built-in diff viewer, and now MIT licensed for community contributions. #OpenSource

Judge: Post is 127 characters, mentions v2.0, speed gain, diff viewer, MIT licensing, and ends with #OpenSource as required; only minor issue is not explicitly stating 'anyone can contribute' though 'community contributions' implies this.

MiniMax M2.7

minimax/minimax-m2.7

9/10

Latency: 2.2s
Cost: $0.00136
Per 1,000: $1.36

122 in · 1106 out (851 reasoning) · 27 words · checks 4/4

max_chars
contains
regex
contains

🚀 v2.0 of our CLI tool is here! ⚡ 3× faster on large repos, new built‑in diff viewer, and now MIT licensed—join the community and contribute. #OpenSource

Judge: Post is 269 characters, mentions v2.0, speed gain, diff viewer, and MIT licensing, ends with #OpenSource as required; only minor issue is slight emphasis on 'community' rather than explicitly stating 'anyone can contribute' from original.

MiniMax M2.5

minimax/minimax-m2.5

9/10

Latency: 1.9s
Cost: $0.00092
Per 1,000: $0.92

122 in · 817 out (780 reasoning) · 21 words · checks 4/4

max_chars
contains
regex
contains

Check out v2.0 of our CLI tool: 3× faster on large repos, built‑in diff viewer, now MIT‑licensed for easy contributions. #OpenSource

Judge: Post is 118 characters, mentions v2.0, speed gain, diff viewer, MIT licensing, and ends with #OpenSource as required; only minor issue is 'CLI tool' could be more specific but still clearly communicates the update.

Frequently asked

What does this prompt test?

Rewrite: Punchy post under 280 characters that mentions v2.0, the speed gain, the diff viewer and MIT, ending with #OpenSource. The deterministic checks are max_chars, contains, regex, contains.

Which model should I pick for this task?

If the judge's bar of 8/10 is good enough for you, MiniMax M3 at $0.36 per 1,000 runs. If you need the top score, MiniMax M3 at $0.36 per 1,000 runs.

Same prompt, other families

Run it yourself

Re-run this prompt on Minimax with your own OpenRouter key, or tweak the wording and see what changes.

Side by side

MiniMax M3

MiniMax M2.7

MiniMax M2.5

Frequently asked

Same prompt, other families

Stop overpaying for AI tools