GPT-5.5 vs GPT-5.4 vs GPT-5.4 mini vs GPT-5.4 Nano vs GPT-5.3-Codex on event announcement to structured json
OpenAI models side by side on "Event announcement to structured JSON": GPT-5.4 Nano scores 10/10; GPT-5.4 Nano is the cheapest answer scoring 8+ at $0.10 per 1,000 runs. Outputs, checks, judge reasons, latency and cost.
The prompt every model received
System
You are a data extraction engine. Reply with JSON only, no prose, no code fences.
User
Return one JSON object with keys title (string), date (YYYY-MM-DD), start_time (24-hour HH:MM), location (string), attendees (integer). Use only facts stated in the announcement.
Announcement: Join us for the Autumn Data Meetup on Tuesday 3 November 2026. Doors open at 2 pm and talks start at 2:30 pm at The Loft, 14 Harbour Street. We have confirmed 48 attendees so far and can take up to 60.
Rubric for the judge: Correctly picks the talk start (14:30, not doors), ISO date, integer attendees 48, and a sensible title and location.
Side by side
Every cell is one OpenRouter call at temperature 0 with the prompt's token cap and reasoning effort "low" where the model supports it. Cost is usage × the catalogue rate in models.json. Quality is one judge call to anthropic/claude-haiku-4.5 against the prompt's rubric, cached per prompt version.
GPT-5.5
openai/gpt-5.5
10/10
Latency
398ms
Cost
$0.00406
Per 1,000
$4.06
128 in · 114 out (69 reasoning) · 7 words · checks 5/5
✓json_valid
✓json_keys
✓contains
✓contains
✓regex
{"title":"Autumn Data Meetup","date":"2026-11-03","start_time":"14:30","location":"The Loft, 14 Harbour Street","attendees":48}
Judge: All fields correctly extracted: title matches announcement, date in ISO format (2026-11-03), start_time correctly uses talk start time (14:30) not door opening, location fully specified, and attendees set to confirmed count (48).
GPT-5.4
openai/gpt-5.4
10/10
Latency
350ms
Cost
$0.00229
Per 1,000
$2.29
128 in · 131 out (86 reasoning) · 7 words · checks 5/5
✓json_valid
✓json_keys
✓contains
✓contains
✓regex
{"title":"Autumn Data Meetup","date":"2026-11-03","start_time":"14:30","location":"The Loft, 14 Harbour Street","attendees":48}
Judge: All fields correctly extracted: title matches announcement, date in ISO format (2026-11-03), start_time correctly uses talk start time (14:30) not door opening, location fully specified, and attendees set to confirmed count (48).
GPT-5.4 mini
openai/gpt-5.4-mini
10/10
Latency
350ms
Cost
$0.00056
Per 1,000
$0.56
128 in · 102 out (57 reasoning) · 7 words · checks 5/5
✓json_valid
✓json_keys
✓contains
✓contains
✓regex
{"title":"Autumn Data Meetup","date":"2026-11-03","start_time":"14:30","location":"The Loft, 14 Harbour Street","attendees":48}
Judge: All fields correctly extracted: title matches announcement, date in ISO format (2026-11-03), start_time correctly uses talk start time (14:30) not door opening, location fully specified, and attendees set to confirmed count (48).
GPT-5.4 Nano
openai/gpt-5.4-nano
10/10
top judge scorecheapest scoring 8+
Latency
299ms
Cost
$9.9e-5
Per 1,000
$0.10
128 in · 59 out · 18 words · checks 5/5
✓json_valid
✓json_keys
✓contains
✓contains
✓regex
{
"title": "Autumn Data Meetup",
"date": "2026-11-03",
"start_time": "14:30",
"location": "The Loft, 14 Harbour Street",
"attendees": 48
}
Judge: All fields correctly extracted: title matches announcement, date is proper ISO format, start_time correctly uses talk start (14:30) not door opening, location is complete and accurate, and attendees count is 48 as stated.
GPT-5.3-Codex
openai/gpt-5.3-codex
10/10
Latency
344ms
Cost
$0.00217
Per 1,000
$2.17
128 in · 139 out (94 reasoning) · 7 words · checks 5/5
✓json_valid
✓json_keys
✓contains
✓contains
✓regex
{"title":"Autumn Data Meetup","date":"2026-11-03","start_time":"14:30","location":"The Loft, 14 Harbour Street","attendees":48}
Judge: All fields correctly extracted: title matches announcement, date in ISO format (2026-11-03), start_time correctly uses talk start time (14:30) not door opening, location fully specified, and attendees set to confirmed count (48).
Frequently asked
▸What does this prompt test?
Extract JSON: Correctly picks the talk start (14:30, not doors), ISO date, integer attendees 48, and a sensible title and location. The deterministic checks are json_valid, json_keys, contains, contains, regex.
▸Which model should I pick for this task?
If the judge's bar of 8/10 is good enough for you, GPT-5.4 Nano at $0.10 per 1,000 runs. If you need the top score, GPT-5.4 Nano at $0.10 per 1,000 runs.
If our calculators helped you cut down on hidden AI wallet leaks, thanks for using them. A tiny fraction of your savings is what keeps our pricing indexes updated daily.
Not sure which AI is cheapest for your use case? Find out in 30 seconds — no signup required.