Summarise · 3 checks · max 400 tokens · benched 2026-09-16

MiniMax M3 vs MiniMax M2.7 vs MiniMax M2.5 on one-sentence changelog summary

Minimax models side by side on "One-sentence changelog summary": MiniMax M2.5 scores 9/10; MiniMax M2.5 is the cheapest answer scoring 8+ at $0.42 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.

The prompt every model received

User

Summarise this release note in one sentence of at most 30 words. Output only the sentence.

Release 4.7.0: The public API now enforces a rate limit of 600 requests per minute per key (previously unlimited). Requests over the limit return HTTP 429 with a Retry-After header. Webhook deliveries are now signed with HMAC-SHA256 and the old unsigned mode will be removed in 4.9. We also fixed a bug where exporting more than 10,000 rows produced an empty file.

Rubric for the judge: A single accurate sentence that prioritises the rate limit and signed webhooks; no bullet list, no preamble.

Side by side

Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.

MiniMax M3

minimax/minimax-m3

9/10

Latency: 989ms
Cost: $0.00155
Per 1,000: $1.55

285 in · 1243 out (1188 reasoning) · 29 words · checks 2/3

max_words
contains
regex

Release 4.7.0 adds a 600 requests/minute rate limit per API key, signs webhooks with HMAC-SHA256 (unsigned mode removed in 4.9), and fixes exports over 10,000 rows producing empty files.

Judge: Accurate single sentence under 30 words (28), prioritizes rate limit and signed webhooks as required, no preamble or bullet list, minor: could emphasize the security aspect of HMAC-SHA256 more prominently.

MiniMax M2.7

minimax/minimax-m2.7

9/10

Latency: 2.6s
Cost: $0.00096
Per 1,000: $0.96

150 in · 759 out (711 reasoning) · 27 words · checks 2/3

max_words
contains
regex



Release 4.7.0 introduces a 600 req/min rate limit per key (HTTP 429 with Retry-After), signs webhook deliveries with HMAC‑SHA256, and fixes empty export bug for >10k rows.

Judge: Accurate single sentence under 30 words (28 words), prioritizes rate limit and signed webhooks as required, no preamble or bullet list, minor: uses abbreviation 'req/min' which is clear but slightly informal.

MiniMax M2.5

minimax/minimax-m2.5

9/10

top judge scorecheapest scoring 8+

Latency: 1.2s
Cost: $0.00042
Per 1,000: $0.42

147 in · 357 out (304 reasoning) · 26 words · checks 2/3

max_words
contains
regex

Release 4.7.0 adds a 600 requests per minute rate limit, returns HTTP 429 with Retry-After, signs webhooks with HMAC-SHA256, and fixes the 10,000+ row export bug.

Judge: Accurate single sentence under 30 words (27 words) prioritizing rate limit and signed webhooks as required, with no preamble or bullet list.

Frequently asked

What does this prompt test?

Summarise: A single accurate sentence that prioritises the rate limit and signed webhooks; no bullet list, no preamble. The deterministic checks are max_words, contains, regex.

Which model should I pick for this task?

If the judge's bar of 8/10 is good enough for you, MiniMax M2.5 at $0.42 per 1,000 runs. If you need the top score, MiniMax M2.5 at $0.42 per 1,000 runs.

Same prompt, other families

Run it yourself

Re-run this prompt on Minimax with your own OpenRouter key, or tweak the wording and see what changes.

Side by side

MiniMax M3

MiniMax M2.7

MiniMax M2.5

Frequently asked

Same prompt, other families

Stop overpaying for AI tools