Reasoning · 1 checks · max 800 tokens · benched 2026-09-16

Muse Spark 1.3 vs Muse Glimmer 30B vs Llama 4 Maverick vs Llama 4 Scout on count sellable units

Meta models side by side on "Count sellable units": Muse Glimmer 30B scores 10/10; Muse Glimmer 30B is the cheapest answer scoring 8+ at $0.23 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.

The prompt every model received

System

Think carefully, then give only the final answer in the requested format.

User

A warehouse receives 3 pallets. Each pallet holds 48 boxes and each box holds 12 units. On inspection, 15% of the boxes are damaged; round the number of damaged boxes down to a whole box. The damaged boxes are discarded. Then 7 undamaged boxes are sent to the quality lab and are not sold. How many units are left to sell? Reply with only the number.

Rubric for the judge: The single correct answer 1392 (144 boxes, 21 damaged, 7 to the lab, 116 x 12).

Side by side

Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.

Muse Spark 1.3

meta/muse-spark-1.3

unjudged

failed: OpenRouter HTTP 403: This model requires you to complete the following before use: 18+ age confirmation. Confirm at https://openrouter.ai/settings/preferences.

Latency: 0ms
Cost: $0
Per 1,000: $0

0 in · 0 out · 0 words · checks 0/1

exact

(empty output)

Judge: —

Muse Glimmer 30B

meta/muse-glimmer-30b

10/10

top judge scorecheapest scoring 8+

Latency: 346ms
Cost: $0.00023
Per 1,000: $0.23

126 in · 187 out (179 reasoning) · 1 words · checks 1/1

exact

Judge: The output matches the correct answer of 1392 units exactly, provided in the required format of a bare number only.

Llama 4 Maverick

meta-llama/llama-4-maverick

10/10

Latency: 394ms
Cost: $0.00027
Per 1,000: $0.27

113 in · 353 out · 255 words · checks 0/1

exact

## Step 1: Calculate the total number of boxes received.
First, we need to find out how many boxes are received in total. Since there are 3 pallets, and each pallet holds 48 boxes, the total number of boxes is 3 * 48 = 144.

## Step 2: Calculate the total number of units received.
Each box holds 12 units, so the total number of units is 144 * 12 = 1728.

## Step 3: Determine the number of damaged boxes.
15% of the boxes are damaged. To find the number of damaged boxes, we calculate 15% of 144, which is 0.15 * 144 = 21.6.

## Step 4: Round down the number of damaged boxes to the nearest whole number.
Rounding down 21.6 gives us 21 damaged boxes.

## Step 5: Calculate the number of undamaged boxes.
The total number of boxes is 144, and 21 are damaged, so the number of undamaged boxes is 144 - 21 = 123.

## Step 6: Calculate the number of boxes sent to the quality lab.
7 undamaged boxes are sent to the quality lab.

## Step 7: Calculate the number of boxes left to sell.
After discarding the damaged boxes and sending 7 to the lab, the number of boxes left to sell is 123 - 7 = 116.

## Step 8: Calculate the total number of units left to sell.
Since each box contains 12 units, the total number of units left to sell is 116 * 12 = 1392.

The final answer is: $\boxed{1392}$

Judge: The output correctly calculates all steps (144 total boxes, 21 damaged boxes rounded down, 123 undamaged boxes, 116 boxes after lab removal, 1392 units to sell) and arrives at the exact answer specified in the rubric, though it includes detailed working when only the number was requested.

Llama 4 Scout

meta-llama/llama-4-scout

3/10

Latency: 1.4s
Cost: $0.00010
Per 1,000: $0.10

113 in · 308 out · 213 words · checks 0/1

exact

To find the number of units left to sell, let's calculate step by step.

## Step 1: Calculate the total number of boxes received.
The warehouse receives 3 pallets, and each pallet holds 48 boxes. So, the total number of boxes received is \(3 \times 48 = 144\) boxes.

## 2: Calculate the total number of units received.
Each box holds 12 units. So, the total number of units received is \(144 \times 12 = 1728\) units.

## 3: Calculate the number of damaged boxes.
15% of the boxes are damaged. So, the number of damaged boxes is \(0.15 \times 144 = 21.6\). Rounding down to a whole box gives 21 damaged boxes.

## 4: Calculate the number of undamaged boxes before sending any to the quality lab.
The number of undamaged boxes is \(144 - 21 = 123\) boxes.

## 5: Calculate the number of undamaged boxes after sending some to the quality lab.
7 undamaged boxes are sent to the quality lab. So, the number of undamaged boxes left is \(123 - 7 = 116\) boxes.

## 6: Calculate the number of units left to sell.
Each box holds 12 units. So, the number of units left to sell is \(116 \times 12 = 1392\) units.

The final answer is: $\boxed{1392}$

Judge: The output provides the correct numerical answer (1392) but violates the explicit instruction to 'Reply with only the number' by including extensive step-by-step working and formatting.

Frequently asked

What does this prompt test?

Reasoning: The single correct answer 1392 (144 boxes, 21 damaged, 7 to the lab, 116 x 12). The deterministic checks are exact.

Which model should I pick for this task?

If the judge's bar of 8/10 is good enough for you, Muse Glimmer 30B at $0.23 per 1,000 runs. If you need the top score, Muse Glimmer 30B at $0.23 per 1,000 runs.

Same prompt, other families

Run it yourself

Re-run this prompt on Meta with your own OpenRouter key, or tweak the wording and see what changes.