SQL · 4 checks · max 500 tokens · benched 2026-09-16

Mistral Large 3 2512 vs Mistral Medium 3.5 vs Mistral Small 4 vs Ministral 3 8B 2512 on products over 100 units with having

Mistral AI models side by side on "Products over 100 units with HAVING": Ministral 3 8B 2512 scores 10/10; Ministral 3 8B 2512 is the cheapest answer scoring 8+ at $0.02 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.

The prompt every model received

System

You are a database engineer. Reply with a single SQL statement and nothing else.

User

Tables: products(id, name) and order_items(product_id, quantity). Write one standard SQL query that lists product names whose total quantity sold across all order_items is greater than 100. Filter the aggregate with a HAVING clause.

Rubric for the judge: Join, SUM(quantity), GROUP BY product, HAVING > 100; returns names only; no WHERE on the aggregate.

Side by side

Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.

Mistral Large 3 2512

mistralai/mistral-large-2512

10/10

Latency: 567ms
Cost: $0.00011
Per 1,000: $0.11

71 in · 50 out · 22 words · checks 4/4

regex
regex
regex
regex

```sql
SELECT p.name
FROM products p
JOIN order_items oi ON p.id = oi.product_id
GROUP BY p.id, p.name
HAVING SUM(oi.quantity) > 100;
```

Judge: Query correctly joins products and order_items, groups by product, uses HAVING with SUM(quantity) > 100, returns only names, and contains no WHERE clause on the aggregate.

Mistral Medium 3.5

mistralai/mistral-medium-3-5

10/10

Latency: 985ms
Cost: $0.00325
Per 1,000: $3.25

83 in · 417 out (392 reasoning) · 20 words · checks 4/4

regex
regex
regex
regex

SELECT p.name FROM products p JOIN order_items oi ON p.id = oi.product_id GROUP BY p.id, p.name HAVING SUM(oi.quantity) > 100

Judge: Query correctly joins tables, groups by product, uses HAVING with SUM(quantity) > 100, returns names only, and contains no WHERE clause filtering the aggregate.

Mistral Small 4

mistralai/mistral-small-2603

10/10

Latency: 383ms
Cost: $0.00021
Per 1,000: $0.21

83 in · 327 out (302 reasoning) · 21 words · checks 4/4

regex
regex
regex
regex

```sql
SELECT p.name FROM products p JOIN order_items oi ON p.id = oi.product_id GROUP BY p.name HAVING SUM(oi.quantity) > 100;
```

Judge: Query correctly joins products and order_items, groups by product name, uses HAVING with SUM(quantity) > 100, returns only names, and contains no WHERE clause filtering the aggregate.

Ministral 3 8B 2512

mistralai/ministral-8b-2512

10/10

top judge scorecheapest scoring 8+

Latency: 390ms
Cost: $1.8e-5
Per 1,000: $0.02

71 in · 50 out · 22 words · checks 4/4

regex
regex
regex
regex

```sql
SELECT p.name
FROM products p
JOIN order_items oi ON p.id = oi.product_id
GROUP BY p.id, p.name
HAVING SUM(oi.quantity) > 100;
```

Judge: Query correctly joins products and order_items, groups by product, uses HAVING with SUM(quantity) > 100, returns only names, and contains no WHERE clause on the aggregate.

Frequently asked

What does this prompt test?

SQL: Join, SUM(quantity), GROUP BY product, HAVING > 100; returns names only; no WHERE on the aggregate. The deterministic checks are regex, regex, regex, regex.

Which model should I pick for this task?

If the judge's bar of 8/10 is good enough for you, Ministral 3 8B 2512 at $0.02 per 1,000 runs. If you need the top score, Ministral 3 8B 2512 at $0.02 per 1,000 runs.

Same prompt, other families

Run it yourself

Re-run this prompt on Mistral AI with your own OpenRouter key, or tweak the wording and see what changes.

Side by side

Mistral Large 3 2512

Mistral Medium 3.5

Mistral Small 4

Ministral 3 8B 2512

Frequently asked

Same prompt, other families

Stop overpaying for AI tools