Every flagship ships 1M context now. Your novel fits. That's not the question

Kimi K3, DeepSeek V4, Claude Fable 5 and GPT-5.6 all carry million-token windows as of July 2026 — a whole 500k-word serial fits in one request. Our five-tier control experiment says fitting is not learning: a model handed an entire novel with no instruction wrote clichés at ten times the original author's density, and one explicit sentence did what 200,000 tokens of raw prose couldn't. Plus the arithmetic: filling K3's window costs about $3.15 per press.

A vast library stuffed with books rising into darkness, and at its center one small writing desk under a single warm lamp

The spec sheets converged this summer. Claude Fable 5 launched June 9 with a million-token window as the default, no beta header, no long-context surcharge. DeepSeek’s V4 line carries 1M across all official services. GPT-5.6 reads 1.05M. And on July 16, 2026 — two days before this post — Moonshot shipped Kimi K3 with a 1,048,576-token window at one flat rate. Google, for the record, has been past this milestone since 2024, when Gemini 1.5 Pro opened a 2M window to all developers, and this spring’s coverage reports 2M again on the newest Ultra tier. The marketing pitch for readers writes itself: your entire serial finally fits in one request, so the AI can finally write it properly.

We happen to have run the control experiment for that pitch before the race got loud. The short answer: fitting is not learning. The rest of this post is the data, and the bill.

The arms race, dated and sourced

ModelWindowChecked 2026-07-18
Kimi K3 (July 16, 2026)1,048,576 tokens, flat pricingMoonshot platform docs
DeepSeek V4 (flash / pro)1M tokens, default on all official servicesDeepSeek model page
Claude Fable 5 (June 9, 2026)1M tokens default, 128k outputAnthropic context docs
GPT-5.6 family1.05M tokens, 128k outputOpenAI launch page
Gemini 3 family1M in / 64k out (2M shipped on 1.5 Pro in 2024)Gemini developer guide

By the arithmetic in our context-window explainer — which answers the beginner question this page skips, namely what a window even is — a 500k-word serial runs roughly 625k to 830k tokens. Under every row of that table, it fits. Three years ago it didn’t fit one-fifth of the way in. That flip is real, and it’s worth taking seriously before we take it apart.

The experiment the pitch never runs

If window size were the binding constraint on faithful continuation, more original prose in context should mean output more like the original. So we measured exactly that, before our multi-round benchmarks: a single-shot control across five context tiers, from 4k tokens of original prose up to 200k — at the top tier, an entire 270k-character fantasy novel, crammed in whole. The full write-up is currently published in Chinese; the numbers below are from that run.

The no-instruction arm is the one that kills the pitch. Handed the whole book and told nothing about style, the model wrote boilerplate similes at ten times the original author’s density — the Chinese equivalents of “as if” and “a wisp of” on every page, in a novel whose author uses about one simile per thousand characters. All that prose sat in the window, and the model went on writing in its own default voice. It saw everything. It imitated itself.

The instruction arm is the counter-shot. One explicit sentence — treat the original passages as the style baseline — and the largest window didn’t drown it out: the direction held at 200k just as it did at 4k. Across models, tier-to-tier differences in the single-shot setting were mild either way. What separated faithful from unfaithful was never how much of the book the model saw. It was whether anyone told it what the material was for. Volume is a substrate; the baseline declaration is the mechanism. The second one is free.

The bill for cramming

Now the honest ledger, using the friendliest pricing in the table. Kimi K3 charges $3.00 per million input tokens, flat across the window — no long-context tier, which is genuinely the least hostile billing design of the bunch. A cold request filling all 1,048,576 tokens: about $3.15 of input, before the model writes a word. Your 700k-token serial: about $2.10 per press of the continue button. Twenty presses over an evening of reading is roughly $42 of input, re-buying the same unchanged chapters twenty times.

Caching is the standard rebuttal, and it deserves a fair hearing. K3 prices cached input at $0.30 per million, so a warm re-send of that serial drops to about $0.21 — a 90% discount, automatic on stable prefixes. The catch is the word stable: the discount holds only while the prompt prefix stays byte-identical, and continuation is precisely the workload where you edit a paragraph, regenerate a scene, branch at a choice point. Every upstream change resets the meter to $3.00 territory for everything after it. Caching rewards append-only reading; it does not absolve cramming. GPT-5.6 Terra runs the same errand at $2.50 per million — the explainer post did that arithmetic and landed on $1.75 per press.

What the big windows are actually good for

Credit where due. The 1M generation removed a real failure: on 200k-class windows, a long serial literally could not be sent, and the oldest chapters were amputated unread. That failure is gone, and workflows that need one huge read — summarize this whole book, find every scene with this character — got materially better. What the big windows did not fix is retrieval within the window: OpenAI’s own long-context eval on the GPT-5.6 launch page reports 73.8% on retrieving 8 planted items at 512K-1M depth. That is the vendor grading its own product, at the depth where chapter 3 of your serial lives. And nothing at any window size fixes cross-request persistence, which remains zero — next press, you send it all again.

Feed the scene, not the shelf

Our position hasn’t changed since before the arms race: the window is a reading budget, and the winning move is spending it on relevance instead of volume. Always-on facts — who the protagonist is, how the magic works — travel in full with every request. Everything situational becomes lorebook entries with trigger keywords, entering the request only when the current passage mentions the Northern March, costing zero tokens the rest of the time. The 360 rounds of continuation behind our style benchmark and our failure-mode study all ran inside fixed 16k-token windows — scene, triggered entries, recent prose — and across 360 rounds, none of the failures we documented would have been fixed by the millionth token. The restart loops and mid-run freezes happened inside contexts a 2023 model could hold.

The world-organizer page shows what that structure looks like in Foreverse. The honest close is an admission: we’d rather sell you a 16k-token habit than a million-token bill, and on our own benchmark data the habit also writes better fiction.

FAQ

Is a 1M context window worth paying for if I read and continue fiction?

Mostly no, if the plan is cramming the whole book in. The big windows solved "doesn't fit" — a 500k-word serial runs roughly 625k to 830k tokens and now fits with room to spare. They didn't solve "fits but gets skimmed" (OpenAI's own eval reports 73.8% retrieval at 512K-1M depth), and they didn't change what our control experiment showed: raw prose volume doesn't transfer style. Our 360-round continuation benchmark ran entirely inside 16k-token windows and never needed more.

Does a bigger context window make the AI write more like the original author?

Not by itself. We ran a five-tier control from 4k to 200k tokens of original prose in context. With no style instruction, the model handed an entire 270k-character novel still wrote boilerplate similes at ten times the original author's density, in its own default voice. With one explicit baseline sentence — anchor style to the original passages — the direction held at 200k just as it did at 4k. The instruction did the work; the extra 196k tokens did not.

How much does it cost to actually fill a 1M window?

Kimi K3 prices input at $3.00 per million tokens, flat across its 1,048,576-token window, so one cold full-window request costs about $3.15 before output. A 700k-token serial costs about $2.10 of input per continuation press; twenty presses in an evening is roughly $42, paying for the same unchanged chapters twenty times. Prefix caching drops repeat input to $0.30 per million — real relief, but only while the prefix stays byte-identical, and editing or regenerating a passage upstream resets it.

If not the whole book, what should the AI see?

A structured slice: the always-on facts (protagonist, world rules) re-sent every turn, plus lorebook entries keyed to trigger words so each faction or subplot enters the request only when the current scene mentions it. That is how our own benchmark runs stayed inside 16k tokens across 360 rounds. The window arithmetic explains why cramming loses; relevance-gated feeding is what replaces it.

Questions or ideas? Join our Discord →

Is a 1M-Token Context Window Worth It for Fiction? We Ran the Control Experiment · Foreverse · Xinmeng