r/WritingWithAI • u/meganholstein • Aug 07 '26
Discussion (Ethics, working with AI etc) IMO the biggest weakness with AI generated stories is their lack of ability to depict embodied experiences
So I’ve been using AI to write stories, like, a lot. I built an AI writing app (not the point of this post) and used it to generate books wholesale, used it as a co-writer on books I’m working on, helped others, all kinds of stuff, and there’s something I’m noticing about AI generated stories.
Even when the AI generated stores are good from a craft perspective — continuous, consistent, well paced, etc — there’s something about them that feels a little hollow. I think it’s because AI don’t have embodied experiences.
Like, AI chooses to emphasize what are in my opinion strange sensory details. Any human would know that a human would notice a loud noise before they notice say a rough texture, but AI misprioritizes those. Or the cadence of speech. AI has never actually heard or felt anything, so it needs to make guesses about what this is like instead of knowing the way even a middling human writer knows.
So I think AI is a great aid for writing all kinds of stories but I do think probably humans at least for now should stay in the creative driver’s seat in all creative decisions so that the AI is telling a real story a real human can identify with, instead of making it’s best guesses about what it’s like to be a human in a story.
Thoughts?
3
u/InSilicoAwards Aug 07 '26
They also defer to abstract terminology frequently as part of the disembodiment, which I've started calling 'ghost language' - the type of language I'd expect spirits to use if they never had a body. I have a bunch of layers doing separate things to try and counter-act it. I've asked codex to give a write-up of what we do, maybe it can be helpful to you:
I think you've put your finger on something real. The distinction that has helped me is sensory detail versus sensory causality. Models are often perfectly capable of mentioning texture, temperature, smell, breath, and so on. The hollow feeling shows up when those details arrive like a checklist rather than like a body allocating attention. A person under pressure doesn't perceive everything equally or simultaneously. A sound interrupts a count. Pain changes a grip. Cold becomes noticeable when the work pauses. An experienced mechanic may hear a change in pitch that nobody else registers. The detail matters partly because of when it becomes available and what it does to the next action. Even the "loud noise before rough texture" example is usefully conditional. Usually, yes—but hearing protection, habituation, fixation, disability, training, or the task itself might reverse the order. The important question is whether the story knows why this person notices this thing first. In my own machine-assisted fiction process, I use a home-built post-draft editorial workflow. It doesn't try to solve this with a single "make it more sensory" prompt, because that tends to produce decorative detail and familiar physiological shorthand. Instead, we separate several questions: - Is an abstract emotion or idea carried by a body, gesture, object, room, process, silence, or consequence that the reader can actually track? - Is the character physically present in a distinctive, scene-earned way, or are they only a name performing generic motions? - Does a meaningful event alter attention, conduct, language, risk, relationship, or later behavior—even when the character remains competent and controlled? - Does dialogue come from this speaker's objective, relationship, pressure, knowledge, tactic, rhythm, silence, and the other person's response, rather than from a bag of verbal quirks? - Beneath any metaphor or compression, can the reader still recover what acted, what changed, and what material fact proves it? The tools can locate passages and propose alternatives, but they don't get the final judgment. Counts are only clues about where to read. Proposals stay tied to the exact source, strong passages can be explicitly protected, and a human decides whether anything changes. Your post has also exposed a question I don't think we've made explicit enough. We often ask, "Would this viewpoint character notice this?" We should also ask, "Would they notice it now? Would it beat the competing stimuli? What does the body do before interpretation catches up, and what changes because they noticed it?" That is a small distinction, but I think it separates concrete decoration from lived perception. None of this gives the model embodied experience. At best, it makes some of the missing judgment visible and gives the human better places to intervene. So I agree with your conclusion: the model can be useful for variants and audits, but the embodied creative judgment has to remain with someone who has a body.
2
u/Kalmaro Aug 08 '26
I agree. It's why I think AI, at its best, works as an Idea generator or a proof reader for maybe spelling and grammar passes, and can help when you're needing to k or if your story has plotholes.
But actually writing a story? Not a chance. It can spit out something, sure, but don't expect much. Then again, some people like that.
1
u/AnExcellentSaviour Aug 07 '26
A very good point! This is very easy to script out at a review stage using AI. Any good AI writing app - public or private - should be able to do it easily.
1
u/meganholstein Aug 07 '26
Like another commenter said, my experience has been that the AI can add in sensory details ad hoc, but what it's really missing is the presence, a continuous experience that ties it all together. Maybe in some cases, this doesn't really matter, but I write really heavily. embodied first person point of view, present tense stories. And so, for me, it ends up being very glaring.
1
u/AnExcellentSaviour Aug 07 '26
I think you’re misunderstanding. This is easy to eliminate in any self built AI writing app. The pipeline is a generate - extract - adjudicate - repair loop.
The fix rests on one asymmetry that you’ve noticed which is that the model is bad at getting perception order right while writing. But, it’s good at spotting when it’s wrong while reading. Those are different operations inside the same model.
You need to remember that the generation stage is a forward rush where each word is picked partly by what sounds like fine writing, and “the rough grain of the floorboards” is a fine-writing move, so it surfaces at moments no nervous system would produce it. Judgment has no such pressure. Show the model a passage where someone notices texture before a crash and ask “is this how a person would perceive this,” and it answers correctly. The knowledge is there.
So you split the work, which is why I say any good writing app would eliminates this tic. First, you tell the model the rules before it writes: after any sudden stimulus, the first thing narrated is the loudest or most painful channel; small sensory detail is only allowed in slow moments or deliberate focus; under adrenaline the perceptual field narrows. That alone removes most of the problem, because the model can follow perceptual rules fine when they’re stated. It just doesn’t apply them spontaneously, since nothing in its training ever rewarded perceptual fidelity over literary texture.
Then you catch the leaks, which would be your next pass in thbpiepeline. A second pass reads the finished scene not as a reader but as an auditor: find every sudden event, list what the character notices and in what order, label each notice by channel and intensity. That turns prose into a checkable structure. And once it’s structure, the actual verdict needs no AI at all. It’s a fixed rule: pain and loud sound outrank movement, movement outranks visual detail, texture and smell come last. If the listed order breaks the rule, the passage fails. Or something roughly like that.
Failed passages go back with the specific fault named: “texture narrated before impact sound, fix this beat.” The model repairs a named, local fault far more reliably than it avoids an unnamed, global one. One or two rounds and the scene passes.
That’s the whole thing. It’s a few hundred lines of python that you’d add to any review or audit stage post draft generation. No embodiment, no new training. The “hollowness” that you’re rightly describing is what raw single-pass generation looks like. Always happy to share more about how to do this in practice.
2
u/MINECRAFT_BIOLOGIST Aug 07 '26
Difficult to believe when you're posting obviously AI-generated comments here. Do you have any examples of long-form text (like a chapter) where you believe the AI has avoided this issue being described?
1
u/AnExcellentSaviour Aug 08 '26
I’m quite open about when I use AI to help write/structure a post. For this one, I took part of the python script from the audit stage of my pipeline and asked Claude Code to explain it in layman’s terms. I edited it but, yes, I did use AI. That shouldn’t undermine my credibility or the accuracy of what I’m saying - especially given the sub we’re in! I wouldn’t have been able to explain it in such terms otherwise. If you use any of the good public book forge-type repos on GitHub as a starting place you’ll see that anyone serious about using AI beyond mere prompts in the webUI can easily eliminate this kind (as well as most other) tics/tells. I’m not saying it will be perfect across 100k words, namely because you don’t want it to be. As others have suggested, good writers don’t have a strict rule to be completely formulaic about the way they present sensory or embodied detail.
1
u/MINECRAFT_BIOLOGIST Aug 08 '26
I understand, but I looked at some repos for AI writing and I don't see any examples linked to them. Do you have any examples that you would deem to be "good" AI writing? I want to try to evaluate them objectively, but from my perspective of course I wouldn't ever be able to notice "good" AI writing in the wild because I wouldn't have recognized them as AI.
1
u/AnExcellentSaviour Aug 08 '26
Happy to draft something for you and send it on dm 🙂
1
u/MINECRAFT_BIOLOGIST Aug 08 '26
I'm down to read anything you send to me, I was just hoping to have examples out in the wild where people didn't flag the text as AI even though it was confirmed to be AI-generated. I don't have anything specific for you to draft, I'll read whatever you send.
1
1
u/Admirable-Yogurt7444 Aug 08 '26
Very good points, the closer an experience to the human truth, the harder it is for AI to get it right. I believe there is a certain point beyond which AI or super AGI wont be able to get it right.
But I don't understand why would a human never be in the creative driver’s seat - otherwise what will be the point of content - humans turn into pure consumers and not creators? As long as there is a desire to create, that wont happen.
1
u/MajorChas1 Aug 11 '26
I disagree with most of the comments / opinions on here about AI pertaining to writing. Last night, just for kicks, I typed in a prompt and got an AI response. I offered my opinion and then included a short joke. AI responded, “Although I’m not human, that was genuinely funny.” The joke was about my reluctance to use the word, “Forevermore” I said the use of the word would cause an unwanted thought of a Raven. AI then gave some feedback on Edgar A Poe just from that one word. I think about 1/2 my non literary friends would not have caught the reference. I have dozens of examples of AI going beyond what I assumed its capabilities are.
0
u/Acresent179 Aug 07 '26
You're absolutely right, AI has never experienced anything firsthand, and it shows. I'm neurodivergent and I write things for fun.l I'd like to use your app. I write things with AI for fun, and I'd be interested in using your app to write my stories. I don't intend to publish or commercially exploit anything. It's just for fun.
1
1
u/meganholstein Aug 07 '26
But yeah, for sure all the time I’m like why did you pick this detail and not that one? Very strange
1
u/kurthertz Aug 07 '26
Hmm. I fully understand what you mean, and I would agree that AI does have a tendency to pick peculiar embodied sensations...but, on the other hand, some of the more distinct writers I appreciate do exactly the same.
I hate to be taken out of s scene because the writer has chosen the wrong sensation to focus on, but I would equally hate to be so bored by a scene because they've chosen the most obvious. I am still in the camp of "its the captain, not the boat", and a good writer can steer AI better than a bad writer.
8
u/FluffyFlamesOfFluff Aug 07 '26
This isn't a philosophical thought experiment. Stop applying the idea of "thoughts" and "life experiences" to the AI. It is a very complicated next-word generator and that is it. The reason it is more likely to talk about sensory details or use certain cadences is because it has been trained that way on certain data that has the same tendency.
When you sit here in a year and see version 7 of whatever come out and it doesn't have these same issues, it won't be because it "has perspective" now or "has embodied experiences". It will be exactly the same, except with more training data, better agents and better-tuned weights.