Model rankings
Models ranked by quality, speed, and cost.
Compare the live MindsHub catalog by capability, response time, and measured cost per task. For models outside the catalog, see the blog.
What are you building?
Start with the free model. When a task needs more, pick by the kind of work you run.
Start here, free
Start free with the MindsHub Air model.
An alias we keep pointed at a balanced, general-purpose model, so
the model behind it can change without a code change on your side.
Free within fair use in MindsHub
Cowork, Code and the API. Call it as mindshub_air.
When a task needs more
Pick by the job below. Every model on this board is served through the same key and balance, at the rates on the rate card.
Air has no web search and no reasoning dial. Air's board row mirrors the model it points at and may briefly lag an alias change.
-
Agentic coding
Many steps, many files, and the model has to keep its own plan straight for an hour. A one-shot index only half predicts that, so run your own repo through the top two.
- Pick
- GPT 5.6 Sol orClaude Opus 5
- On a budget
- DeepSeek V4 Pro $0.67/task at top effort
-
The genuinely hard problems
Research, analysis and anything where being wrong is expensive.
- Pick
- Claude Fable 5.1 orClaude Opus 5
- On a budget
- GPT 5.6 Sol $1.99/task at top effort
-
Anything a person waits on
Chat, voice, autocomplete. The first token has to land before attention does.
- Pick
- Gemini 3.7 Flash orGPT 5.6 Luna
-
Documents, images, audio, video
One request carrying a whole corpus of mixed media, reasoned over as a unit.
- Pick
- Gemini 3.7 Flash orMuse Spark 1.2
- On a budget
- Gemini 3.1 Pro Preview $0.67/task at top effort
-
High volume, tight budget
Classification, extraction, tagging — millions of calls where the bill is the constraint.
- Pick
- GPT 5.6 Luna orGPT 5.4 Nano
-
Weights you can run yourself
Data that cannot leave your environment, or volume that beats renting.
- On a budget
- GLM 5.3 Flash $0.25/task at top effort
Compare the full catalog.
Sort and filter the table, then expand a row for context, modalities, reasoning settings, and billing notes.
| 53 Frontier | — | 68 tok/sec | — | $3.26 | $10 / $50 our rate | 1M | Closed | |
| Hard end-to-end work across code, browsers, and professional files
| ||||||||
| 53 Frontier | 77 | 70 tok/sec | 3.6s first token | $7.63 | $10 / $50 our rate | 1M | Closed | |
| Anthropic's newest frontier model, safeguard fallback included
| ||||||||
| 51 Frontier | 72.4 | 62 tok/sec | 3.2s first token | $5.86 | $5 / $25 our rate | 1M | Closed | |
| Frontier reasoning built for long, many-step agentic runs
| ||||||||
| 50 Frontier | 75 | 70 tok/sec | 3.6s first token | $8.75 | $10 / $50 our rate | 1M | Closed | |
| The previous Fable, for traffic already validated against it
| ||||||||
| 48 Frontier | — | 344 tok/sec | — | $1.60 | $1.25 / $4.25 our rate | 1M | Closed | |
| Long-context agentic coding that reads text, images and video
| ||||||||
| 47 Frontier | 75.6 | 70 tok/sec | 2.0s first token | $1.99 | $5 / $30 our rate | 1M | Closed | |
| OpenAI's flagship all-rounder
| ||||||||
| 45 Frontier | 65 | 68 tok/sec | 1.6s first token | $2.01 | $1.40 / $4.40 our rate | 1M | Open GLM-5.3 licence (commercial use restricted) | |
| Frontier-class coding and security review at a low rate
| ||||||||
| 44 Near-frontier | 60.2 | 42 tok/sec | 3.4s first token | $2.00 | $3 / $15 our rate | 1M | Open Kimi K3 licence (commercial use restricted) | |
| Long autonomous coding runs you can self-host
| ||||||||
| 44 Near-frontier | 60 | 68 tok/sec | 1.2s first token | $2.32 | $2 / $6 our rate | 500K | Closed | |
| Reasoning with access to the live web
| ||||||||
| 42 Near-frontier | 62 | 110 tok/sec | 1.5s first token | $0.25 | $0.15 / $0.50 our rate | 1M | Open MIT | |
| A high score per dollar, on MIT-licensed weights
| ||||||||
| 42 Near-frontier | 66 | 118 tok/sec | 1.3s first token | $1.40 | $2 / $12 our rate | 1M | Closed | |
| Balanced mid-tier for everyday work
| ||||||||
| 41 Strong | — | 343 tok/sec | — | $1.24 | $0.75 / $3.75 our rate | 1M | Closed | |
| Fast multimodal agents and long coding work
| ||||||||
| 40 Strong | — | 227 tok/sec | — | $0.27 | $0.22 / $0.66 our rate | 1M | Open MIT | |
| Low-cost text and image work on MIT-licensed weights
| ||||||||
| 40 Strong | 54 | 211 tok/sec | 0.7s first token | $0.97 | $1.25 / $4.25 our rate | 1M | Closed | |
| Cheap closed model that powers the free Meta AI
| ||||||||
| 40 Strong | 56 | 40 tok/sec | 4.1s first token | $2.16 | $2 / $6 our rate | 984K | Open Qwen licence (commercial use restricted) | |
| The open checkpoint that matches the Qwen flagship
| ||||||||
| 39 Strong | 72 | 335 tok/sec | 0.5s first token | $0.93 | $0.75 / $3.75 our rate | 1M | Closed | |
| Fast multimodal work at a promotional price
| ||||||||
| 39 Strong | 56 | 60 tok/sec | 1.4s first token | $1.04 | $2 / $6 our rate | 500K | Closed | |
| The previous Grok, and now the better-value one
| ||||||||
| 39 Strong | 62 | 62 tok/sec | 1.8s first token | — | $1.40 / $4.40 our rate | 1M | Open MIT | |
| The previous GLM release, with the same coding profile
| ||||||||
| 38 Solid | 48 | 120 tok/sec | 0.5s first token | $0.18 | $0.20 / $1.20 our rate | 1M | Closed | |
| Our alias, kept on whichever model balances best
| ||||||||
| 38 Solid | 48 | 120 tok/sec | 0.5s first token | $0.18 | $0.20 / $1.20 our rate | 1M | Closed | |
| Fast and cheap for high-volume work
| ||||||||
| 38 Solid | 70 | 89 tok/sec | 2.4s first token | $5.09 | $2 / $10 our rate | 1M | Closed | |
| The lighter Claude, for simpler and shorter tasks
| ||||||||
| 38 Solid | 68 | 139 tok/sec | 1.7s first token | — | $1.75 / $14 our rate | 400K | Closed | |
| Coding specialist for repo-scale changes
| ||||||||
| 38 Solid | 52 | 150 tok/sec | 0.8s first token | — | $1.25 / $4.25 our rate | 1M | Closed | |
| Every input type, at an open-model rate
| ||||||||
| 36 Solid | 58.6 | 75 tok/sec | 2.6s first token | $0.67 | $1.32 / $3.96 our rate | 1M | Open MIT | |
| Open-weight reasoning and coding at a budget rate
| ||||||||
| 35 Solid | 52 | 239 tok/sec | 0.9s first token | $0.22 | $0.22 / $0.66 our rate | 1M | Open MIT | |
| The previous DeepSeek Flash, MIT-licensed and self-hostable
| ||||||||
| 34 Solid | 68.8 | 216 tok/sec | 0.6s first token | $0.93 | $0.75 / $3.75 our rate | 1M | Closed | |
| Fast, high-volume everyday tasks
| ||||||||
| 33 Light | — | 210 tok/sec | 1.0s first token | $1.56 | $1.50 / $9 our rate | 1M | Closed | |
| The legacy Google Flash, for workloads already built on it
| ||||||||
| 32 Light | 50 | 150 tok/sec | 0.7s first token | — | $0.75 / $4.50 our rate | 400K | Closed | |
| Small and cheap for routine automation
| ||||||||
| 30 Light | 68.8 | 120 tok/sec | 1.6s first token | $0.67 | $2 / $12 our rate | 1M | Closed | |
| Huge documents, images, audio and video
| ||||||||
| 26 Light | — | 180 tok/sec | 0.9s first token | — | $0.50 / $3 our rate | 1M | Closed | |
| Preview-era Flash, kept so early integrations keep running
| ||||||||
| 22 Basic | 30 | 220 tok/sec | 0.4s first token | — | $0.20 / $1.25 our rate | 400K | Closed | |
| Built for throughput on bulk, simple work
| ||||||||
| 18 Basic | 43.4 | 101 tok/sec | 1.1s first token | $0.21 | $1 / $5 our rate | 200K | Closed | |
| Fastest Claude, for high-volume simple work
| ||||||||
| 16 Basic | — | 288 tok/sec | — | $0.04 | $0.25 / $1.50 our rate | 1M | Closed | |
| Lite-tier extraction and classification at scale
| ||||||||
| — | — | — | — | — | $0.35 / $0.75 our rate | — | Closed | |
| ||||||||
| — | — | — | — | — | $0.15 / $0.60 our rate | — | Closed | |
| ||||||||
- Quality & Cost/task
- Artificial Analysis's published figures, on Intelligence Index v4.3 — they measure independently of us — at each model's top reasoning effort, so both are a ceiling. Expand a row for the level we send.
- Coding, Speed & Latency
- Speed is Artificial Analysis's published median where they publish one; coding and latency are our own read. Close values are ties, not differences.
- Price
- Per 1M tokens, in / out. Everything else about the bill — prompt-cache rates, long-prompt tiers and search — is on the full rate card.
- Missing figures
- ≈ is our estimate. — means nobody has published one.
- Checked
- Quality and cost per task against Artificial Analysis's table on ; list prices and speeds last refreshed from their API on . Our rates are from a committed snapshot right now.
One alias per line, pointed at the model we serve for it.
A rotating alias such as gpt always resolves to the most
recent version of that line we serve, so it can move without a code
change on your side. Every other model on the board also has a fixed alias
that names one exact version and never moves; MindsHub Air is the one
rotating alias with no fixed counterpart, by design.
| Rotating alias | Currently serves | Fixed alias | Older versions still served |
|---|---|---|---|
mindshub_air | Whichever model balances cost, speed and intelligence best — see its board row. | — | — |
mindshub_blaze | MindsHub Blaze Also served via Fireworks AI. | — | — |
sonnet | Claude Sonnet 5 | sonnet-5 | — |
opus | Claude Opus 5 | opus-5 | — |
fable | Claude Fable 5.1 | fable-5-1 | Claude Fable 5 |
haiku | Claude Haiku 4.5 | haiku-4-5 | — |
gpt | GPT-6 Astra | gpt-6-astra | GPT 5.6 Sol |
gpt-terra | GPT 5.6 Terra | gpt-terra-5-6 | — |
gpt-luna | GPT 5.6 Luna | gpt-luna-5-6 | — |
gpt-codex | GPT 5.3 Codex | gpt-codex-5-3 | — |
gpt-mini | GPT 5.4 Mini | gpt-mini-5-4 | — |
gpt-nano | GPT 5.4 Nano | gpt-nano-5-4 | — |
gemini | Gemini 3.1 Pro Preview | gemini-3-1-pro | — |
gemini-flash | Gemini 3.8 Flash | gemini-flash-3-8 | Gemini 3.7 Flash, Gemini 3.6 Flash, Gemini 3.5 Flash, Gemini 3 Flash Preview |
gemini-flash-lite | Gemini 3.1 Flash-Lite | gemini-flash-lite-3-1 | — |
kimi | Kimi K3 | kimi-k3 | — |
deepseek | DeepSeek V4 Pro | deepseek-v4-pro | — |
deepseek-v4-flash | DeepSeek V4.1 Flash | deepseek-v4-1-flash | DeepSeek V4 Flash |
qwen | Qwen3.8-2.4T-A95B | qwen-3-8-a95b | — |
glm | GLM 5.3 | glm-5-3 | GLM 5.2 |
glm-5-3-flash | GLM 5.3 Flash | glm-flash-5-3 | — |
muse-spark | Muse Spark 1.3 | muse-spark-1-3 | Muse Spark 1.2, Muse Spark 1.1 |
grok | Grok 4.6 | grok-4-6 | Grok 4.5 |
Small score differences are ties.
The top 4 scorers sit within 3 points of each other, which is close enough to be noise. When quality is that level, speed and cost decide.
A benchmark averages many tasks and can hide weaknesses that matter to you. Use the scores to shortlist two or three models, then test them on your own work. The method below shows how.
Each score is for a model at a specific reasoning setting, usually the top one. Treat it as a ceiling: the same model at a lower setting scores lower and costs less per task.
What each model family offers Read the benchmark behind the score Choose for your workload Point a coding agent at any of them
- GPT-6 Astra 53
- Claude Fable 5.1 53
- Claude Opus 5 51
- Claude Fable 5 50
- Muse Spark 1.3 48
- GPT 5.6 Sol 47
- GLM 5.3 45
- Kimi K3 44
- Grok 4.6 44
- GLM 5.3 Flash 42
- GPT 5.6 Terra 42
- Gemini 3.8 Flash 41
- DeepSeek V4.1 Flash 40
- Muse Spark 1.2 40
- Qwen3.8-2.4T-A95B 40
- Gemini 3.7 Flash 39
- Grok 4.5 39
- GLM 5.2 ≈39
- MindsHub Air ≈38
- GPT 5.6 Luna 38
- Claude Sonnet 5 38
- GPT 5.3 Codex ≈38
- Muse Spark 1.1 ≈38
- DeepSeek V4 Pro 36
- DeepSeek V4 Flash 35
- Gemini 3.6 Flash 34
- Gemini 3.5 Flash 33
- GPT 5.4 Mini ≈32
- Gemini 3.1 Pro Preview 30
- Gemini 3 Flash Preview ≈26
- GPT 5.4 Nano ≈22
- Claude Haiku 4.5 18
- Gemini 3.1 Flash-Lite 16
Bars run from zero and are relative to the leader — a truncated axis would manufacture a gap that isn't there. Scores within 3 points of each other are a tie.
Measure the wait and the streaming speed.
Latency is the wait for the first token. Throughput is how quickly the rest arrives. The chart shows both because a model can be strong on one and weak on the other.
- Gemini 3.7 Flash 3.5s
- GPT 5.4 Nano 4.9s
- DeepSeek V4 Flash 5.1s
- Gemini 3.6 Flash 5.2s
- Muse Spark 1.2 5.4s
- Gemini 3.5 Flash 5.8s
- Gemini 3 Flash Preview 6.5s
- GPT 5.4 Mini 7.4s
- Muse Spark 1.1 7.5s
- MindsHub Air 8.8s
- GPT 5.6 Luna 8.8s
- GPT 5.3 Codex 8.9s
- GPT 5.6 Terra 9.8s
- Gemini 3.1 Pro Preview 9.9s
- GLM 5.3 Flash 10.6s
- Claude Haiku 4.5 11.0s
- Claude Sonnet 5 13.6s
- Grok 4.6 15.9s
- DeepSeek V4 Pro 15.9s
- GPT 5.6 Sol 16.3s
- GLM 5.3 16.3s
- Claude Fable 5.1 17.9s
- Claude Fable 5 17.9s
- GLM 5.2 17.9s
- Grok 4.5 18.1s
- Claude Opus 5 19.3s
- Kimi K3 27.2s
- Qwen3.8-2.4T-A95B 29.1s
Wait for the first token Streaming the answer
An 8-fold spread in completion time
Gemini 3.7 Flash finishes that answer in about 3 seconds and Qwen3.8-2.4T-A95B takes about 29. Same answer length, same request. Nobody waits 29 seconds for a chat reply, and both of those models are on this board.
Short answers make latency more important
On a 200-token reply the wait is 23% to 56% of the wall clock, so latency is worth weighting. By a few thousand tokens it is a rounding error and throughput decides alone. The control above the chart switches between the two views.
Measure with your own traffic
Region, prompt length, cache hit rate and reasoning effort all move these figures. Use them to rank candidates, then measure the two you shortlist against your own traffic.
Price per token is not cost per task.
Token prices do not show how many tokens a model will use to finish the job. Reasoning models can vary widely on that second number.
You pay for reasoning tokens as well as the visible answer. A model with a lower token rate can still cost more per completed task.
It is somebody else's task, at each model's top effort, priced at the provider's own rate — so treat it as a way to rank candidates, not a forecast of your bill.
Why cheap models often aren't Two levers that cut the bill The full rate card
- Claude Sonnet 5 2.0× cheaper on paper 2.6× dearer per task
- GLM 5.3 Flash 40.0× cheaper on paper 8.0× cheaper per task
- GLM 5.3 4.5× cheaper on paper 1.0× dearer per task
- Grok 4.6 3.3× cheaper on paper 1.2× dearer per task
- Muse Spark 1.3 4.7× cheaper on paper 1.2× cheaper per task
Both figures come from the same rate card — each provider's own published price, which is what these tasks were costed at, and not always the rate in the Price column above. And the lesson is not that cheap models are a lie: Gemini 3.1 Flash-Lite beats its own rate card — 13.3× cheaper on paper, 49.8× cheaper per task. It is that you cannot rank them by reading price pages.
Choose a model in an afternoon.
Use the board for a shortlist, then test it against real examples.
-
Shortlist two or three from the board
Use the task router above, or filter the board to your constraint — open weights, a modality, a latency ceiling. Stop at three.
-
Collect ten real tasks
With the messy context attached. Not clean samples: the actual ones you ran last week, including the awkward ones.
-
Run them at the effort you would really use
Not maximum. The reasoning dial moves cost further than switching models does, and every published cost-per-task figure is measured at the top setting.
-
Read the token counts off the response
Every provider returns a
usageobject. Multiply input, cached input and output separately — those three rates can differ by an order of magnitude. -
Divide by the results you would actually ship
If eight of ten came back usable, your real cost is the total divided by eight. That division is the one no leaderboard can do for you.
One API key reaches every model here, so a bake-off is a string change rather than three integrations. There's a runnable version, a cost measurement guide, a guide to running evals, and a free working session if you'd rather do it with an engineer.