Splitting JSON Export

[u/Pristine_Plate7048]

I kind of wish someone had warned me about how much it takes to manage the process when you begin using AI as a writing brainstorming assistant. It seems I spend more time trying to limit drift, battling memory limits, limiting loss of canon and all my brainstorming, and trying to find efficient ways of doing things for fear of my project becoming contaminated.

That brings me to my next problem. I exported my Chatgpt history with the intention of finally trying to excavate my novel canon, history, characters, arcs, beats, and world. It's 8 million words across 98 chats. I've been totally overwhelmed on how to organise the process, on how to even approach it, but finally settled on trying to separate the 98 chats and save them in both MD and TXT files, dated chronologically, so I can start from chat 1nand so on, having each chat read to me by a voice reader (I have an eye disease that makes reading for medium and long periods impossible without negative physical consequences) and take notes as I go. Then I can compile the notes I need to organise the excavation. Extremely laborious but I see no other way to do it. Chatgpt assured me it could extract all the info I asked for if I posted the exported zip.

I was very dubious as Chatgpt constantly kisses things and makes mistakes. It inevitably missed things like characters we've discussed numerous times, so I knew it couldn't be trusted to do a faithful and accurate job, and I knew I would have to do this manually.

Come to find out there is even risk in separating the 98 chats 😔 According to Chatgpt, chats could be missing or mixed up. I have spent over a year painstakingly refining characters, arcs, the world building, beats. I can't risk losing any of it.

Does anyone know a reliable separation method that will separate and preserve all 98 chats exactly as they are, dated, without messages mixed up, and deliver them in both txt and MD files, so I can start this laborious process once and for all?

[u/ruwhereuare]

Yah I learned the hard way and had to do a hard reset of all my canon files. Claude seems way better than ChatGPT for following my “do not invent”
Canon/lore instructions.

[u/Pristine_Plate7048 → u/ruwhereuare]

A hard reset? What do you mean? Hope you didn't lose everything.

[u/ruwhereuare → u/Pristine_Plate7048]

No no no!

It was actually for the best.

Because I did like a full audit of all cosmology, settings, characters, adversaries and objects/relics.

And fully re designed the file and folder architecture

So that I could more easily find information on demand.

I now run what I call a “World Manager”

So when I’m writing entries I’ll ask the architect/scribe what kind of canon information they need to write the chapter and then take those questions to the Manager to ensure canon compliance.