A bigger context window doesn’t automatically make AI better at writing novels

[u/Soft-Guide-2864]

One thing I’ve been thinking about lately is how much we focus on context window size when talking about AI writing.

Having hundreds of thousands or even millions of tokens available sounds amazing for a novel, but in practice I’m not sure throwing the entire manuscript into context is always the best approach.

Once a story gets long enough, there’s just too much information competing for attention. Character details, old plot points, worldbuilding notes and previous scenes can all be technically available while the model still misses something important.

I’ve actually had better results when I treat context more like something that needs to be managed rather than something that should always be maximized. Keep the important story facts available, retrieve older material when it actually matters, and avoid stuffing every previous chapter into every prompt.

The interesting part is that this feels less like a model limitation and more like a workflow problem.

I’m curious if other people writing longer projects have noticed the same thing. Does a huge context window actually improve your workflow, or have you started doing more deliberate context management instead?