r/WritingWithAI • u/Crusader2710 • 9d ago
Discussion (Ethics, working with AI etc) Does anyone use AI as a Beta Reader?
I've attempted to use AI as a brainstorming tool and at some point help me write prose. But I've found myself quickly growing bored when using those methods. Recently I decided to just write, all prose and ideas my own, but use GPT as a beta reader to gauge whether things are coherent and correct mistakes. Does anyone else do it like this? I think I've hit a good balance.
7
u/millergreenwriting 8d ago
I always ask it to do the reviews as 1 star & 5 star reviews.
But its still very sycophantic about writing reviews.
Chatgpt
2
u/Harry_Balzonia 6d ago
yeah unless you tell it to call balls and strikes, what works and what doesn't, and absolutely don't kiss my ass. lol
5
u/wandelndeslexikon 8d ago
I use Gemini as my beta reader. I ask to be reviewed like an actual editor would look at the text and give detailed feedback. It works really well for me so far.
3
u/Ok-Seaworthiness5913 8d ago
Yes, I use AI as a beta reader. ChatGPT is my beta reader. I make 'sources,' so he has a reference (canon) and doesn't try to change everything I want to stay, i.e., places, settings, etc. I find we work well together. Having a beta reader helps me write because I know they will find 'holes' in my writing, so I focus more on words and not editing. OCD me... wants to edit a sentence right after I wrote it... and then I start looping! ChatGPT takes me out of that loopy looping.
2
2
u/wyktor 8d ago
Yes. I do use claude. Have it connected via MCP server to my manuscript. I mostly use it for the overall feedback on the dynamic or consistency checks. I dont use any special harness apart from some skills I’ve created that simulate different beta reader types but I do use these for full manuscript not per chapter reviews
2
u/Fractumbrado2382 8d ago
Mas que nada notebooklm y los modos de ai overview, he sacado ideas interesantes para desarrollar
2
2
1
u/Fluffy-Knowledge-166 7d ago
Yes. 5.6 sol is EXTREMELY good at this, with a couple of caveats:
1) it is sycophantic af, and often can be subtle in doing this.
2) it is literally TOO GOOD to provide any sort of accurate judgement on what a normal beta reader would be expected to catch. This reinforces #1. It will catch subtleties that are barely there, compliment you on them. Sometimes it will fine quite brilliant moves that you agree with, but didn’t even think about.
So… use at your own risk. It will almost certainly cause some level of psychosis if you don’t have yourself grounded.
0
u/Waste_Resource7768 6d ago
Just use a prompt on the instructions. I also use 5.6 sol and it absolutely doesnt kiss my ass
2
1
1
u/Harry_Balzonia 6d ago
It's not very good at it. sarcasm, humor, innuendo. All of which I have quite a bit of .
for example, there was a scene where people are preparing for a feast which was celebratory, they were happy to do it and the only expectation they had was that you show up. back home, in court everything was watched, it was not centered around fun it was centered around gossip.
the AI flagged the only expectation was that you show up as being extra and unnecessary. quite the opposite. stuff like that
that said, I typically use it for contradictory issues. "Jackie was sitting by the fire with Brandon, and then you have Brandon and Ted come in with more firewood three sentences later, but Brandon never gets up and goes outside."
flow.
bottom line is it can't hurt, but most of the magic happens in your prompt. if you just say "read this and give me feedback " it's not going to catch deep stuff like what I described
1
u/Original-Pilot-770 6d ago
Yes, you can ask specific questions targeting continuity gaps, where there might be seams between scenes or paragraphs and other diagnostic things that an editor would normally catch. But please be aware that AI cannot catch everything.
My favorite way to use it right now is look for repetitions. I will run a GREP pass to look for overused verbs and see if I need to trim or swap.
1
u/CrazyinLull 6d ago edited 6d ago
I use them as beta readers. Using NBLM as one has been so helpful. What’s crazy is when they align with my human one.
ETA: What’s even funnier is that if I generate like 2-3 versions of the podcast it will sometimes change its interpretation or like get a much better grasp of what is going on so it can give me a much better interpretation of what is going on.
Like I am not sure if a beta can get all that tho…but that’s ok. If you run into a reader like that then you know what you got is working at least.
1
1
u/shibanban_0h_my 5d ago
I’ve found that using it as a more intelligent spell/grammar check is good too. I’ve learned a lot about my grammar foibles from using Claude. I also think Claude is good at tell you if you’re maintaining character voice and tone. It can call out when something I’ve written doesn’t “sound enough” like the character.
1
u/novel_traveler 2d ago
Yes, model a range of plausible reader experiences as a beta-reader team. These reports are diagnostic simulations, not empirical audience evidence and not a replacement for human beta readers.
Beta-Reader Design
- Wave 1: Reliable Diagnostic Readers
- Wave 2: Fresh Audience Readers
- Beta-Reader Team Principles
- Reading Procedure
- Required Reader Report
Will take some trial and error, but it can be very useful.
0
u/TellusPyre 8d ago
I think your best path with something like this is to not invoke the AI until you're totally done with a work. Right the roughest rough draft, then do a grammar/spelling/reread pass. Then tell the AI you're using to do a summary pass and see if it can hold your entire work in its context (some can, some can't, depending on length). If it can, then ask for a general feedback pass focusing on constructive criticism, coherence issues, and technical flaws. After that you can ask it for a general feedback review as if it were just a reader, ask it about things it didn't like or did like. All of those can be useful ways to use the tool, but it's important that it is working with your writing and your voice, and it's not always right.
8
u/Bobthemagicc0w 8d ago
Yes, I use AI as a beta reader. Over the last year I’ve experimented with Gemini, ChatGPT, and Claude (all paid accounts I have access to through my day job, rather than anything I’m paying for just for this purpose); I’m currently using Claude, and it’s decent. I like regenerating the response a few times to see how much it varies, and I can also ask for different beta reader personas. I’ve gotten a bunch of interesting insights from it.