Opus 5 · V2
47.8% KV energy savedAt completion: 47.8% less KV cache energy.
Build DealCommander: a sell-side M&A deal room for an advisor at the highest level. Eleven navigation areas, six mandatory keystone contracts stated up front and tested at the end, a cloud database schema, optional AI drafting that must degrade to deterministic local templates, and an in-app diagnostics suite that proves its own requirements. Apple-grade design quality. No system was shown a prompt before its turn, and no prompt could be re-explained.
This is the benchmark where the output stops being a test answer and becomes a product. Not a script, not a toy, not a demo harness — data tables, a live cloud backend, a real AI API integration, and a diagnostics suite that audits the brief it was built from. You can open the MagLev deliverable on this page and use it.
Across 107 files, with 1,820 lines of CSS and 822 lines of SQL — written autonomously from eleven prompts.
Median file 108 lines, largest 351. Its counterpart on the identical model shipped 7 files over 500, the largest at 2,865.
Against 88.5 for the native harness on the identical model. MagLev won all four graded pairings in this benchmark.
350,498 tokens on every call against MagLev’s 51,608, and it ended at 609,663 while MagLev ended at 42,218.
Every compute figure on this page is computed per request from each system’s own metered logs, using identical formulas on both sides. Open the software MagLev built →
Eleven prompts went in. What came out is a sell-side M&A deal room with full data tables, a Supabase cloud backend, and a live AI API integration for drafting and communication. Other than the eleven prompts, there was no human interaction — no correction, no steering, no repair round.
Codebase
107 files
13,521 lines of product JavaScript, organised across nine modules: core, domain, state, storage, api, ai, ui, diagnostics, and seed data.
Cloud backend
8 tables
822 lines of SQL — schema, row-level security policies, and seed data — for an instant connection to a Supabase project.
AI integration
Real API
A live provider-agnostic AI client for drafting and communication, with no credential anywhere in the source tree and a deterministic local-template fallback when no key is present.
Self-verification
Requirement map
An in-app diagnostics suite that maps every requirement in the brief to the checks covering it, and fails any requirement no check touches.
You do not have to take the grade on faith. The application MagLev built is published on this site. Open it, click through all eleven areas, run its diagnostics, and leave when you are done.
Spotlight: the software it built → Launch DealCommander
Counts are measured directly from the delivered source tree: product files only, excluding test harnesses and tooling (6 files, 2,029 lines). Code volume is not a quality score; it is reported here because the structural comparison below is about how that volume is organised.
Each deliverable was graded against the same rubric built from the brief. In every pairing, the MagLev arm and its comparison system ran the same model.
| Model | MagLev | Comparison system | Difference |
|---|---|---|---|
| Opus 5 | 97 | 88.5 · Claude Code | +8.5 |
| Grok 4.6 | 92 | 83 · Grok Terminal | +9 |
| GPT-5.6-SOL | 88.5 | 76 · Codex | +12.5 |
| Gemini 3.1 Pro | 65 | 62 · Gemini CLI | +3 |
The structural comparison is where the difference becomes concrete. Both sides of the Opus 5 pairing produced a working application of similar scale. Only one of them produced a codebase a team could take over on Monday.
| Measure | MagLev (Opus 5) | Claude Code (Opus 5) |
|---|---|---|
| Product JavaScript files | 107 | 18 |
| Product JavaScript lines | 13,521 | 10,949 |
| Median file length | 108 | 246 |
| Largest product file | 351 | 2,865 |
| Product files over 500 lines | 0 | 7 |
| Lines of SQL delivered | 822 | 844 |
| In-app diagnostic checks | 106 | 40 |
| Requirement-to-check coverage map | Included | Not reported |
Same model. Same brief. Same eleven prompts. One side produced 107 files with a median length of 108 lines and nothing over 500. The other produced 18 files, seven of them over 500 lines and one at 2,865. Both compile; only one is maintainable, and no prompt in the brief asked for either outcome.
Product-source counts exclude test harnesses and tooling on both sides. The apparent extras in the comparison codebase were audited against the brief and found to be unrequested scope, including one database table with no call sites in its own source. Scores are compared within this study, not averaged across rubrics.
This is the size of the prompt on each individual model call, from the first call of the build to the last. It is the one chart that explains every other number on this page — and it is where the two approaches stop resembling each other.
| Arm | Mean tokens / call | Median | Peak | Final call |
|---|---|---|---|---|
| Claude Code (Opus 5) · V2 | 350,498 | 364,569 | 609,663 | 609,663 |
| Claude Code (Opus 5) · V1 | 561,071 | 585,316 | 966,007 | 38,251 |
| Codex (GPT-5.6-SOL) | 116,937 | 122,242 | 202,216 | 58,254 |
| MagLev (Opus 5) · V2 | 51,608 | 46,327 | 129,723 | 42,218 |
| MagLev (Opus 5) · V1 | 46,594 | 43,616 | 107,681 | 35,022 |
| MagLev (GPT-5.6-SOL) | 26,316 | 25,776 | 68,921 | 18,638 |
In V2, the native harness on Opus 5 averages 350,498 tokens per call and ends at its own peak of 609,663 — still climbing when the work runs out. In V1 it climbed to 966,007 and then shed 927,756 tokens in a single step, down to 38,251. Codex did the same thing at 91.4% complete, falling from 202,216 to 31,826. MagLev on the identical model held 51,608 and 46,594 in the two runs, and never exceeded 129,723 in either.
That vertical drop is not a saving. It is compaction: the harness reached the edge of the window, and the session it had been accumulating all build was summarised and thrown away. The cost was already paid to carry it, and the detail does not come back. Every requirement from the early prompts that mattered at the end was inside it.
MagLev never reaches that wall, because it was never walking toward it. Persistent memory means the project is remembered rather than re-read, so the eleventh prompt is answered with the same discipline — and the same cost — as the first. Nothing has to be summarised away, because nothing was being hoarded in the first place. MagLev stays on track like a maglev: the thread is never lost, and it never has to be reconstructed.
Prompt tokens per call as reported by each provider’s own meter, interpolated onto the shared progress grid. Cached and uncached input are both included: this is the size of the package the model was handed, before any billing discount. MagLev arms also show call-to-call variation — they operate from a low ceiling by design, not by truncation at a limit.
The mean of the metered non-MagLev arms against the mean of the metered MagLev arms. Equal weight for every arm; both curves start at zero and accumulate across the build.
At completion: 840 billion attention pairs across 2 comparison arms against 303 billion across 2 MagLev arms — a 63.9% reduction. One metered pairing — Codex against MagLev on GPT-5.6-SOL, V1 — is excluded from this average and disclosed rather than diluted into a mean: on that one small-scale pairing MagLev accumulated more attention pairs, having done several times the work volume and produced several times the output. Each arm is independently normalized to 0–100% progress, with linear interpolation onto a 5% grid. Progress indicates position within the recorded session — not verified feature completion. No curve smoothing is applied.
Cumulative modeled memory-traffic energy at the same normalized progress. Dashed lines are KV-cache energy; solid lines are total modeled energy.
At completion: 47.8% less KV cache energy.
At completion: 73.8% less KV cache energy.
At completion: 64.6% less KV cache energy.
Total modeled energy includes KV-cache and decode weight traffic, under identical fixed assumptions on both sides. These are estimates derived from measured token surfaces — not measured device or datacenter electricity. Where a total-energy surface is not shown, the MagLev arm was higher on it: in three of these four pairings MagLev generated substantially more output, and output tokens carry decode weight traffic regardless of how small the prompt is.
Every figure above is a session total, and a total punishes the system that produced more software. These surfaces divide the same metered work by the output tokens that work produced. Same logs, same formulas, corrected units — and the gap widens.
Mean across these pairings. Work divided by the output it produced, so a longer answer is never charged as a loss.
What the end of the session costs — not the average of an easy first hour and an expensive last one.
How much the prompt grows from the first decile of calls to the last. Dimensionless, so it compares across every vendor.
283 output tokens per second against 63, at each arm's own mean context.
| Pairing | Per delivered token | Terminal rate | Escalation | Sessions / card | Decode rate |
|---|---|---|---|---|---|
| MagLev (Opus 5) vs Claude Code (Opus 5) · V1 | 41.0× | 146× | 8.63× | 12.0× | 12.0× |
| MagLev (GPT-5.6-SOL) vs Codex (GPT-5.6-SOL) · V1 | 9.69× | 2.23× | 1.14× | 4.44× | 4.44× |
| MagLev (Gemini 3.1 Pro) vs Gemini Terminal (Gemini 3.1 Pro) · V1 | 7.80× | 15.4× | 4.77× | 5.40× | 5.40× |
| MagLev (Grok 4.6) vs Grok Terminal (Grok 4.6) · V2 | 13.5× | 34.5× | 4.38× | 3.37× | 3.37× |
| MagLev (Grok 4.6) vs Grok Terminal (Grok 4.6) · V1 | 18.6× | 27.3× | 4.00× | 3.67× | 3.67× |
| MagLev (Opus 5) vs OpenRouter (Auto Mode) · V1 | 3.35× | 12.9× | 13.4× | 1.97× | 1.97× |
| MagLev (Opus 5) vs Claude Code (Opus 5) · V2 | 10.8× | 40.5× | 7.95× | 6.79× | 6.79× |
| MagLev (GPT-5.6-SOL) vs Claude Code (Opus 5) · V3 | 18.7× | 27.6× | 2.95× | 7.45× | 7.45× |
A model call is bounded by how much KV state has to be streamed from memory for every token it writes. Context size therefore converts directly into how many of these sessions fit on one card — here, at each arm's own mean context. The strongest terminal result on this page is MagLev (Opus 5) vs Claude Code (Opus 5) · V1 at 146×.
Ratios are MagLev advantage: how many times more compute the native harness spent to deliver the same unit of output. Sessions per card and decode rate assume one 80 GB H100 SXM at 3.35 TB/s with decode bound by KV traffic; the constants are fixed and identical on both sides. Terminal rate uses the final decile of model calls, with a minimum window so a short arm reports no rate rather than a single-sample one. This section publishes only pairings where MagLev finished ahead on every surface shown. Held back and named here instead: MagLev (GPT-5.6-SOL) vs Codex (GPT-5.6-SOL) · V2 (context escalation at 0.56×).
A sell-side M&A deal room with full data tables, a live cloud backend, and a real AI API connection — built autonomously, graded highest in its field, and delivered in 107 files with nothing over 500 lines. On the identical model, with the identical prompts, the native harness scored lower, shipped a 2,865-line file, and ran its context up to the wall until the session had to be thrown away.
All of it comes from one property: persistent memory. MagLev remembers the project instead of re-reading it, so the thread is never lost, the prompt never swells, and the eleventh prompt costs what the first one cost. That is what MagLev does — it takes the frustration out of creation.
Spotlight: the software it built → Launch DealCommander ← Back to all benchmarks