We ran 360 rounds of continuation. Models fail long fiction in exactly three ways

Nine models (GPT-5.6 Terra, Grok 4.5, Kimi K2.6, Claude Opus 4.8, Gemini 3.1 Pro, DeepSeek V4 ×2, Qwen 3.7 Max, GLM 5.2) each continued two Chinese novels for 20 consecutive rounds. Every long-run failure we observed fits one of three patterns — and the most interesting one hit the model with the best prose mimicry in the field.

Two crossed calligraphy brushes between an ink wuxia slash and an embroidered palace fan

We have now run 360 rounds of novel continuation across nine models and two books — an 8.9M-character Chinese fantasy epic and the palace-intrigue classic Empresses in the Palace. Same protocol every time: continue from a fixed anchor, 20 consecutive rounds, each round’s output appended back into a fixed 16k-token window, then double-blind review with two randomized letter mappings. Every long-run failure we observed fits one of three patterns.

Pattern one: the restart loop

The model ignores everything generated so far and restarts from the original text’s ending — every single round. Gemini 3.1 Pro did this for 20 out of 20 rounds in the fantasy run: twenty phrasings of the same opening instant, a story that never takes its second step.

The root cause was ours, not the model’s. Our context labels which passages are original prose and which are earlier AI continuations, and the explanation line said AI passages were “for plot continuity reference”. Gemini read “reference” as “not canon” and skipped them all. Three ablations pinned it: old wording, 20/20 restarts; label with no explanation at all, still roughly 6 of 8 rounds restarting; explanation rewritten to state the passages are canonical events that must be treated exactly like original prose — zero restarts in 28 rounds across both books. One sentence of prompt wording was the entire difference between disqualification and mid-table.

Pattern two: the mid-run freeze

The model advances normally, then locks onto its own recent output and repeats it verbatim. Grok 4.5 froze in the middle windows of the fantasy run — one stretch repeats the same two paragraphs three times word for word — then partially recovered. On the palace novel it froze harder: both blind reviewers independently wrote “plot rewind” in their notes, and across twenty rounds the story clock never left the afternoon of the inciting incident. Kimi K2.6 showed a milder version, copying whole passages from its own earlier rounds.

This is the classic autoregressive fixed point: as the context fills with the model’s own text, imitating itself becomes easier than advancing. It is also why one-shot writing benchmarks miss it entirely — the loop needs rounds to build up.

Pattern three: the ending rewind

The strangest one, and it hit the best prose mimic in the field. GPT-5.6 Terra’s early and middle windows were, by both reviewers’ judgment, the closest thing to the original author anyone produced — it even reproduced micro-habits like tilde-marked onomatopoeia and the author’s trademark comma rhythm. Then in rounds 18 through 20 it rewound the entire plot back to the anchor point and replayed chapter one, reusing lines from its own round-2 output. Texture stayed perfect; the story folded back on itself.

The lesson we take from it: surface mimicry and long-range plot coherence are separate capabilities. A model can hold an author’s voice flawlessly while losing track of where the story is. On the palace novel, for what it’s worth, Terra never rewound — it took first-tier placement with a zero-incident run.

What survived twenty rounds

DeepSeek V4 Flash won the fantasy run outright — the only system both reviewers called “improving as it goes”, still opening new plot arcs at round 20. Then it dropped to sixth-seventh on the palace novel, where its plain-spoken instincts fight the author’s ornate register, and its sibling V4 Pro — criticized in fantasy for writing “like a finer-penned author” — took first place, because a finer pen is exactly what that book is written with. GLM 5.2 was the only model in the top three of both genres, with one persistent quirk: half-width quotation marks in Chinese prose, in every run, on both books.

No universal ranking survives contact with a second genre. If your app locks you to one model for a whole book, that is a real cost; per-paragraph switching is not a luxury feature, it is how you route around each model’s failure pattern before it locks in.

FAQ

What setup produced these failures?

Each model continued the same novel from the same anchor point for 20 consecutive rounds, with every round's output appended back into a fixed 16k-token context window. That feedback loop is what real reader apps do — and it is what surfaces these failures. One-shot benchmarks never see them.

Are these failures deterministic — will a model always fail the same way?

Mostly consistent, per model per genre, in our data. Grok 4.5 hit repetition loops in both a fantasy epic and a palace-intrigue novel. GPT-5.6 Terra's ending rewind appeared in the fantasy run but not the palace one. Gemini's restart loop was fully explained by one ambiguous sentence in our prompt — after rewording it, zero regressions in 28 rounds across two books.

Does the genre of the book change which model performs best?

Dramatically. Our fantasy champion (DeepSeek V4 Flash) dropped to sixth-seventh place on the palace-intrigue novel, while its sibling V4 Pro — dinged in fantasy for over-describing — took first place there because fine-grained description is exactly that author's style. Same trait, opposite sign, different genre.

What is the practical takeaway for readers using AI continuation?

Pick the model per book, not from a single leaderboard. And prefer apps that let you switch models mid-book: long-run failures build up over rounds, and switching models (or regenerating a segment) resets the loop before it locks in.

Questions or ideas? Join our Discord →

Three Ways LLMs Fail at Long Fiction: Restart Loops, Mid-Run Freezes, and Ending Rewinds · Foreverse · Xinmeng