OverpayingForAIPricing desk

Lesson 3 of 5 · 8 min read · Beginner

Run your own prompt three ways: keyless, your key, Pro

The bench prompts are not your prompt. Run yours: keyless on the site (free, cheapest models, three a day), with your own OpenRouter key (any model, your bill), or on Pro (the whole catalogue on our key).

In this lesson you will

  • Choose the right mode for a test: keyless, own key or Pro
  • Write a prompt with checks so the result is pass/fail, not a feeling
  • Run one live and read the cost line

A leaderboard tells you how models do on our tasks. The only test that matters is yours. The playground run page takes any prompt and sends it to the models you choose; there are three ways to pay for that, and beginners should start with the one that costs nothing.

Three ways to run a prompt in the playground.
ModeWhat it runsWhat it costs youBest for
Keyless$0 rows and the cheapest model per familyNothing; three runs per visitor per dayFirst tests, and proving a cheap model is enough
Your own OpenRouter keyAny model on OpenRouterYour key's balance, at catalogue rates; a typical short run is a fraction of a centTesting the exact model you plan to use
ProThe whole catalogue on the site's key, results savedThe Pro subscription; runs draw from a monthly creditRepeating a test across many families without managing keys

Writing a prompt that gives a pass/fail answer

  1. 1

    State the output shape in the first line

    "Return one JSON object with keys…" or "Output three lines, nothing else." Vague prompts produce answers that are impossible to score.

  2. 2

    Put the facts in the prompt

    Paste the text the model should work from. A self-contained prompt gives every model the same information, which is the whole point.

  3. 3

    Add two or three checks

    A contains for a fact that must appear, a not_contains for one that must not, a max_words for length. Checks turn 'looks fine' into a badge.

  4. 4

    Run it keyless first

    If the cheapest model passes every check, you have your answer and it cost nothing. Only reach for a key if it fails.

Try it

One-sentence release note

Three free runs a day on the site key. Add your own key for unlimited runs.

Three badges: length, the required phrase, and a regex that fails if there is more than one sentence. When all three are green on a keyless model, note the cost line; it will be a fraction of a cent. That is the number you will compare against the flagship in the next lesson.

Knowledge check

You want to know whether the cheapest model can extract five fields from your invoices as JSON. Which mode should you try first, and why?

Lesson FAQ

How many free playground runs do I get?

Three keyless runs per visitor per day at the time of writing, limited to $0 rows and the cheapest model in each family. Paste your own OpenRouter key for unlimited runs on any model at your own cost.

What is an OpenRouter key and is it safe to paste?

A key from openrouter.ai that lets you pay per token for hundreds of models. The playground uses it for your runs only; set a spend limit on the key first, and revoke it afterwards if you are cautious. Never paste a key you cannot afford to lose.

What are checks?

Pass/fail rules scored on the answer: contains, not_contains, max_words, regex, json_valid and exact. They are the same scorer the bench uses, so your prompt's checks are directly comparable to the leaderboard's.

Finished reading?

Mark it done to track your progress through the course.

Save progress across devices

Get a private link that restores your lessons on any device. Email is optional and only used to send you the link.

Compare, calculate, decide

If our calculators helped you cut down on hidden AI wallet leaks, thanks for using them. A tiny fraction of your savings is what keeps our pricing indexes updated daily.

Not sure which AI is cheapest for your use case? Find out in 30 seconds — no signup required.

AI cost intelligence

Stop overpaying for AI tools

Join the OverpayingForAI list for pricing updates, cheaper alternatives, and practical buying guidance.

Now tracking 50+ AI tools, models, platforms, subscriptions, coding tools, and automation products.

We use your email only for OverpayingForAI updates. Unsubscribe anytime.