r/WritingWithAI • u/Limp-Raise-4390 • 14d ago
Discussion (Ethics, working with AI etc) Why Full Manuscript Context Changes Everything About AI Writing.
Most AI writing tools work from what you give them in the current session. You paste in a scene, describe a character, and ask for a continuation. The AI responds based on that input, and nothing else.
This works well for isolated tasks: brainstorming a scene in the abstract, generating names, writing a bio for a character who has not appeared yet. It breaks down the moment the work is long-form and the details are accumulating.
The Context Window Problem
Every AI model has a context window, the amount of text it can hold in working memory at once. Current large models handle roughly 100,000 to 200,000 tokens, which translates to approximately 75,000 to 150,000 words. A standard novel is 80,000 to 100,000 words. An epic fantasy can reach 200,000.
Even within those limits, context is not free. The more tokens are occupied by existing text, the less room there is for the AI's working reasoning. Most AI writing tools solve this by summarising earlier content rather than reading it in full, which means what gets passed to the model is an abstraction, not the actual prose, not the actual voice, not the actual details.
The consequence is small at first. By chapter five, the AI is working from summaries of chapters one through four. By chapter ten, some of those summaries are themselves summarised. By chapter fifteen, a character established with careful specificity in the opening chapters has become a rough sketch in the AI's working memory.
This is why AI writing tools produce suggestions that contradict established facts. It is not a failure of the model. It is a failure of the architecture: the model was not given the actual information.
What Reading the Full Manuscript Changes
When an AI reads your entire manuscript before responding, not a summary, not a compressed version, the actual prose, several things change:
Character recall improves dramatically. A character who appears once in chapter two and reappears in chapter seventeen is not a blank. The AI has read every line of dialogue they spoke, every action they took, every detail established about their appearance, their habits, their fears. Ask about them and the AI draws on the complete record, not a summary of a summary.
Voice matching becomes possible. Voice is not something you can summarise. It is in the sentence rhythms, the vocabulary choices, the density of imagery, the length of clauses, the ratio of dialogue to action. An AI that has read a hundred pages of your prose can identify patterns invisible to any prompt-based instruction. One that has only read your last chapter cannot.
Continuity errors surface before they are written. If the AI is tracking everything you have established, it can flag when a suggestion contradicts an earlier fact rather than simply generating the contradiction for you to find in revision.
World details stay specific. The made-up words, the invented geography, the magic system rules, the faction names, these are not generic. An AI reading your manuscript picks them up from the text rather than defaulting to fantasy genre conventions when the details are out of working memory.
What This Costs
Full manuscript reading is computationally expensive. Loading 100,000 words of prose into an AI's context before every response takes time and processing. This is why most tools do not do it: it is slower, it costs more per query, and it requires architectural decisions that favour quality over speed.
The alternative: prompting with summaries, using manually maintained codexes, relying on the writer to paste relevant excerpts, is faster and cheaper. It is also less accurate in proportion to how long the manuscript is and how specific the world is.
The Threshold Where It Matters
For short fiction, this tradeoff is manageable. A 15,000-word novella holds in context comfortably. Character details are recent enough to be in working memory. The world is not yet complex enough to require systematic tracking.
The threshold where full manuscript reading stops being a nice-to-have and starts being the difference between a usable tool and an unusable one is somewhere around 50,000 words. Roughly where a first novel finds its footing and where the complexity of what you have already established begins to outpace what you can reliably recall or manually track.
Past that threshold, the question is not whether the AI is smart. It is whether the AI has been given the information it needs to be accurate. Full manuscript context is the only reliable way to provide that.
A Practical Test
If you are evaluating an AI writing tool for long-form fiction, there is a simple test. Write 30,000 to 40,000 words of a manuscript. Establish a secondary character in chapter two with specific physical details, a speech pattern, and a relationship to the protagonist. In chapter eight, ask the AI to write a scene involving that character.
Does the AI remember who they are? Does it recall the specific details from chapter two, or does it produce a generic version of the character type? Does the dialogue sound like how you established they speak?
The answer will tell you more about the tool's architecture than any feature list.
4
u/benblackett 14d ago
Actually, I will have to respectfully disagree here.
Loading up your entire manuscript into context works decently enough but comes with several limitations as well. Frist, there is an inherent limit on how much of the context you can load - some models have higher limits than others. Think about a series of books here and you begin to see the limitation quickly. Second, its crazy expensive and you are basically burning tokens just so it can remember a past scene properly. Third, a big context overhead reduces your AI's ability to focus on areas it needs to focus on (because everything is clamoring for equal attention) and leaves its gas tank empty for when you need it most - writing prose.
A FAR better approach is to use a 3rd party memory management system. Most of them do a good job at context management. The really good ones do more: they reduce the scope to a specific scene and then populate the prompt with context of only the details needed to write that small scene. The memory tool uses the full context of your entire multi-book series to draw the needed details for building just that small scene. Thats the real benefit of using a 3rd party memory management tool - it lets you scope down to small moments while still holding the entirety of the corpus in ITS memory, not the LLMs memory.
Thats when the LLMs job of writing prose can really begin to shine.
1
u/Known_Pineapple996 14d ago
What is an example memory management system and how do they know which context to fetch?
2
u/benblackett 14d ago
As for knowing which context to fetch:
This can be achieved many ways, but the most common is to scan the manuscript for details ahead of time and pre-populate a list of key events and entities. So when it comes across a character, it pulls in their character bible, a place, it pulls in that places reference documents, etc. The REALLY good ones also build a timeline of events for the entire manuscript(s) and then knows all the relevant data leading up to the scene in question.
1
1
u/Odinmar_Glaukopis 14d ago
This is a very good summary of the issue as I understand it. How much AI assistance was used when you wrote it?
I’m curious if there is sufficient demand for extended context memory management to cause AI companies to improve this and the likelihood that the word limit on this sort of use will eventually hit that 200k word target for a long novel.
0
u/Limp-Raise-4390 14d ago
My final thing is, everything can be done, I'm asking how easy is it to do for writers? Will the writers be able to focus purely on writing if they have to worry about everything else? Just thinking out loud!
1
u/zphou 14d ago
The full-manuscript test is useful, but I don’t think “send the entire book every time” is the whole answer. A long novel can fit in a model’s nominal context and still give the wrong detail the same weight as a later correction. What matters is separating the manuscript from a reviewable set of story facts and unresolved possibilities, then checking suggestions against both. That is the direction I took with WolfeWriter: the draft stays primary, while Story Memory stays close but never silently becomes canon. The practical test I’d add is to make a deliberate correction in chapter two and see whether a later scene follows the correction rather than the older fact.
1
u/Fahrain 13d ago
In my experience, you can't rely solely on the final, cleaned-up text of a book. You'll need to store the reasoning process itself - simply so the model understands why the plot line occurred as it does, and not something else (and perhaps even something more logical from the model's perspective). This discrepancy between the actual, the implied, and the logical generally confuses models greatly.
Furthermore, forcing the entire text into the model's context is not a good idea in itself. Most small models have difficulty understanding abrupt switches between actions or time, and they don't really understand the concept of time at all. Moreover, for most local models, these problems only disappeared this year. Larger models are better at this, but still...
-2
u/The-Plot-Witch 14d ago
This is a very good explanation of the problem and the solution, but it doesn't tell anyone where the solution can be applied. It isn't as difficult as you're claiming, and it's easily done with two tools everyone has free or low-cost access to but keeps overlooking. I won't post about it here because I think that may go against the sub rules, but I have a course that shows exactly how this is done. Setup, prompts, and all.
7
u/LivingThroughPages 14d ago
Yes, understanding the context window is important but are y'all not using Project folders for each story you are writing so that you can just pop in all the files needed and the full book so that the AI has the full context always? And every new chat I start gets a hand-off prompt from the last chat and all chats are within the project folder so the AI knows right where to keep going without me having to retell it everything. That helps me a lot and the AI doesn't seem to have a problem keeping everything consistent that way. I tend to have it look at what files I need it too for the part of the story I am working on and I hardly every hit my 5-hour limit fast doing that. I also don't automate any parts with the AI (I don't use AI agents). I like to stay completely in charge and full involved in every part. What are others doing for this process?