Run one prompt across a whole family, from your browser, at your own cost.
Paste an OpenRouter key and the page calls openrouter.ai directly, three models at a time. Each answer is scored with the same checks and priced from the same catalogue as the weekly bench. No key? You get three runs a day on the cheapest model per family, or 200 runs a month on any model with Pro.
Whose key
[system] You are a concise assistant. Follow length limits exactly and output plain text only. Summarise the following customer support thread in no more than 60 words. Mention what the customer wanted and how it was resolved. --- Customer (Mon 09:12): Hi, I was charged twice for my Team plan on 1 September. Order references are 88213 and 88214. I only have one workspace. Can you fix this? Agent (Mon 10:40): Sorry about that. I can see the duplicate charge. Could you confirm the last four digits of the card so I can raise the refund? Customer (Mon 11:02): 4471. Agent (Mon 11:30): Thanks. I have refunded order 88214 in full (USD 96.00). It should appear on your statement within 5 business days. I have also added a note so it cannot recur next cycle. Customer (Mon 11:35): Great, thanks for the quick turnaround. ---
3 checks · max 400 tokens · Summarise
Models in Anthropic
Precomputed leaderboards
Questions
Where does my OpenRouter key go?
Only to openrouter.ai, straight from your browser. It is stored in your browser's localStorage under opfa-openrouter-key if you tick 'remember', and never sent to overpayingforai.com. Clear it with the button next to the field.
What does keyless mode allow?
Three runs per day per visitor on the site's key, limited to :free catalogue rows and the cheapest model in each family, with identical prompts served from a cache. It exists so you can try the page, not to replace your own key.
What does 'Our key (Pro)' add?
Pro accounts can run any current API model in the catalogue on the site's OpenRouter key: 200 live runs a month inside a $5 credit, priced from the same models.json rates as the calculator. Each call is checked against the remaining credit before it is made, and results can be saved to your account and exported as CSV.
How is the cost calculated?
Token usage from the response multiplied by the model's rate in the same models.json catalogue the calculator uses. OpenRouter's own reported cost is shown alongside when it returns one.