Grok 4.5 loses on benchmarks and might win anyway
Grok 4.5 trails Fable 5 and GPT 5.5 on the hardest coding tests. It is also a quarter of Opus's price and burns 4x fewer tokens, which might matter more.
By The Daily Query · · 3 min read
The most interesting thing about Grok 4.5 is not that it is good. It is that it is cheap enough to make you stop asking how good it is. xAI shipped the model this week, with a public release set for July 9, built on its new V9 foundation of roughly 1.5 trillion parameters. Musk is calling it Opus-class. On the benchmarks it is not quite that. On the price tag it is something else entirely.
Start with the numbers, because they are the whole story. Grok 4.5 costs $2 per million input tokens and $6 per million output. Opus 4.8 charges $5 and $25. GPT 5.5 runs $5 and $30. Fable 5 sits at $10 and $50. So Grok's output tokens cost about a quarter of Opus and less than an eighth of Fable, in the same rough performance tier.
Then it compounds the discount. By xAI's own measurement, Grok 4.5 resolves SWE Bench Pro tasks using about 4.2 times fewer output tokens than Opus 4.8, and it serves them at 80 tokens per second. So it is cheaper per token, and it spends far fewer of them to finish the same job. Two discounts stacked on top of each other.
The benchmarks it actually loses
Somebody should say this plainly, because xAI was not loud about it. On DeepSWE 1.1, Grok 4.5 scores 53 percent against Fable 5's 70 and GPT 5.5's 67. On SWE Bench Pro it gets 64.7 percent to Fable 5's 80.4. It is close on Terminal Bench 2.1, at 83.3 percent versus 84.3 for Fable and 83.4 for GPT, and it takes first place on Harvey's legal-agent benchmark. But on the hardest coding evals, it is a visible step behind the frontier. If you rank models by leaderboard, Grok 4.5 is not the one winning.
Why the price might beat the scores
Here is the thing about agentic coding, the workload everyone actually cares about now. You do not pay for intelligence, you pay for tokens. An agent left to run for an hour burns millions of them. At that scale, a model that is ninety percent as capable at a quarter of the price and four times the token efficiency becomes the obvious default for anything you run at volume. The benchmark gap is real. The invoice gap is bigger, and it is the one your finance team reads.
The Cursor tell
One detail explains the entire strategy. SpaceX bought Cursor, the AI coding editor, in June for a reported $60 billion in stock. xAI then trained Grok 4.5 on Cursor data to sharpen its coding, and the model now ships inside Cursor on every plan. So Musk owns the model, the data it learned from, and the editor millions of developers already write code in. Call it what it is: a vertical-integration play wearing a model launch as a costume. That should worry his rivals more than the token price does.
The claim that should make you squint
Then there is the line from Musk's announcement that got less attention than it earned. xAI says it intends to ship a completely new, from-scratch-trained model every month for the rest of 2026. Take that with as much salt as you keep in the house. Training a frontier model from scratch on a monthly cadence is a wild promise even by his standards, and "we will ship X every month" has a famously short lifespan. But he does have the compute, and he just bought the tool to feed it. I would bet against monthly. I would not bet against fast.
Cheap is a strategy
Grok 4.5 will not win the benchmark threads, and it does not need to. Musk noticed something his rivals keep pricing as if they have not: for the people running agents all day, cheap and fast and good-enough beats brilliant and expensive nearly every time. Pair it with the tricks developers already use to cut their token bills and the math gets even harder to argue with. The frontier labs are selling the smartest model in the room. xAI is selling the cheapest seat at the table, and tables fill up.
enjoyed this one?_
Get the next one in your inbox.
One email every morning. The best AI tools, reviews, and reads, decoded in five minutes.
up_next → AI News
OpenAI Shipped GPT-5.6 to 20 Companies and the Government First. That's the Whole Story.
GPT-5.6 arrived as three models, Sol, Terra, and Luna, but only to about 20 organizations after OpenAI showed the US government first. The 'voluntary early access' idea just became real.