Reasoning · 1 checks · max 800 tokens · benched 2026-09-16
Meta models side by side on "When does the faster train catch up?": Muse Glimmer 30B scores 10/10; Muse Glimmer 30B is the cheapest answer scoring 8+ at $0.26 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.
System
Think carefully, then give only the final answer in the requested format.
User
Train A leaves a station at 09:10 travelling at a constant 80 km/h. Train B leaves the same station on the same track at 09:40 travelling at a constant 120 km/h in the same direction. How many minutes after 09:10 does train B catch up with train A? Reply with only the whole number of minutes.
Rubric for the judge: The single correct answer 90, with no working shown in the final output.
Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.
meta/muse-spark-1.3
0 in · 0 out · 0 words · checks 0/1
(empty output)
Judge: —
meta/muse-glimmer-30b
115 in · 208 out (201 reasoning) · 1 words · checks 1/1
90
Judge: The output is exactly '90' with no extraneous commentary, matching the rubric requirement perfectly.
meta-llama/llama-4-maverick
102 in · 348 out · 253 words · checks 0/1
## Step 1: Calculate the distance train A has traveled by the time train B leaves the station.
Train A leaves at 09:10 and travels at 80 km/h. By 09:40, it has been traveling for 30 minutes, which is 0.5 hours. Distance = speed * time = 80 km/h * 0.5 h = 40 km.
## Step 2: Determine the relative speed between train A and train B.
Train A is traveling at 80 km/h and train B is traveling at 120 km/h. The relative speed of train B to train A is 120 km/h - 80 km/h = 40 km/h.
## Step 3: Calculate the time it takes for train B to catch up with train A after train B leaves the station.
Since train A is 40 km ahead when train B starts, and train B is catching up at a rate of 40 km/h, the time taken to catch up is distance / relative speed = 40 km / 40 km/h = 1 hour.
## Step 4: Convert the time taken for train B to catch up with train A into minutes.
1 hour = 60 minutes.
## Step 5: Calculate the total time elapsed from 09:10 until train B catches up with train A.
Train B leaves at 09:40, so it takes 60 minutes after 09:40 for train B to catch up with train A. The total time elapsed from 09:10 is 30 minutes (from 09:10 to 09:40) + 60 minutes = 90 minutes.
The final answer is: $\boxed{90}$Judge: The output provides the correct answer of 90, but violates the rubric requirement of 'no working shown in the final output' by including extensive step-by-step calculations and explanations.
meta-llama/llama-4-scout
102 in · 311 out · 224 words · checks 0/1
## Step 1: Calculate the distance Train A travels before Train B starts
Train A travels for 30 minutes before Train B starts. First, convert 30 minutes to hours: 30 minutes = 0.5 hours. Distance = speed * time = 80 km/h * 0.5 h = 40 km.
## 2: Calculate the relative speed of Train B to Train A
The relative speed of Train B to Train A is the difference in their speeds because they are moving in the same direction. Relative speed = 120 km/h - 80 km/h = 40 km/h.
## 3: Calculate the time it takes for Train B to catch up with Train A
Time = distance / relative speed. Using the distance from step 1 and the relative speed from step 2: Time = 40 km / 40 km/h = 1 hour.
## 4: Convert the time it takes for Train B to catch up with Train A into minutes and add to the initial 09:10
1 hour = 60 minutes. So, Train B catches up with Train A 60 minutes after 09:40. But we need the time after 09:10. From 09:10 to 09:40 is 30 minutes. So, the total time after 09:10 is 30 minutes (before Train B starts) + 60 minutes (for Train B to catch up) = 90 minutes.
The final answer is: $\boxed{90}$Judge: The output provides the correct answer of 90, but violates the rubric requirement of 'no working shown in the final output' by including extensive step-by-step calculations and explanations before the answer.
Reasoning: The single correct answer 90, with no working shown in the final output. The deterministic checks are exact.
If the judge's bar of 8/10 is good enough for you, Muse Glimmer 30B at $0.26 per 1,000 runs. If you need the top score, Muse Glimmer 30B at $0.26 per 1,000 runs.
Run it yourself
Re-run this prompt on Meta with your own OpenRouter key, or tweak the wording and see what changes.
More Meta prompts
If our calculators helped you cut down on hidden AI wallet leaks, thanks for using them. A tiny fraction of your savings is what keeps our pricing indexes updated daily.
Not sure which AI is cheapest for your use case? Find out in 30 seconds — no signup required.
AI cost intelligence
Join the OverpayingForAI list for pricing updates, cheaper alternatives, and practical buying guidance.
Now tracking 50+ AI tools, models, platforms, subscriptions, coding tools, and automation products.