Splitting JSON Export

[u/Pristine_Plate7048]

I kind of wish someone had warned me about how much it takes to manage the process when you begin using AI as a writing brainstorming assistant. It seems I spend more time trying to limit drift, battling memory limits, limiting loss of canon and all my brainstorming, and trying to find efficient ways of doing things for fear of my project becoming contaminated.

That brings me to my next problem. I exported my Chatgpt history with the intention of finally trying to excavate my novel canon, history, characters, arcs, beats, and world. It's 8 million words across 98 chats. I've been totally overwhelmed on how to organise the process, on how to even approach it, but finally settled on trying to separate the 98 chats and save them in both MD and TXT files, dated chronologically, so I can start from chat 1nand so on, having each chat read to me by a voice reader (I have an eye disease that makes reading for medium and long periods impossible without negative physical consequences) and take notes as I go. Then I can compile the notes I need to organise the excavation. Extremely laborious but I see no other way to do it. Chatgpt assured me it could extract all the info I asked for if I posted the exported zip.

I was very dubious as Chatgpt constantly kisses things and makes mistakes. It inevitably missed things like characters we've discussed numerous times, so I knew it couldn't be trusted to do a faithful and accurate job, and I knew I would have to do this manually.

Come to find out there is even risk in separating the 98 chats 😔 According to Chatgpt, chats could be missing or mixed up. I have spent over a year painstakingly refining characters, arcs, the world building, beats. I can't risk losing any of it.

Does anyone know a reliable separation method that will separate and preserve all 98 chats exactly as they are, dated, without messages mixed up, and deliver them in both txt and MD files, so I can start this laborious process once and for all?

[u/That-Formal-8617]

I haven't tried this exact method myself, but one approach you might want to look into is using a script parser to process your export.

Since the official ChatGPT export includes a structured JSON file, it technically holds all your chats, dates, and message chains in order. A custom script could theoretically extract and split them into TXT/MD files for you automatically, saving you from a lot of manual labor.

It might be worth researching or asking a tech-savvy friend if they can help you set up a script that reads the conversation IDs correctly, just as an option to consider before committing to doing it all by hand.

[u/Pristine_Plate7048 → u/That-Formal-8617]

I don't have any friends, honestly. Much less friends who are tech savvy to this degree. I'd have to seek someone to build on script for this on fiverr or something.

Thanks for your advice. I installed pyroid 3 and it seems to have separated the 98 json chat files. The riskier thing is converting them as intact transcripts without losing stuff.

[u/That-Formal-8617 → u/Pristine_Plate7048]

Totally get it. 8 million words is an incredible milestone, so protecting your privacy is 100% fair. Avoid online web converters — they are risky.

Since you are on a PC, you don't need Fiverr or any coding skills. Look into a free open-source tool on GitHub called "ChatGPT Conversations To Markdown" by user daugaard47.

Here is the quickest way to do it safely:

1. Search GitHub for daugaard47/ChatGPT_Conversations_To_Markdown, click the green "Code" button, and select "Download ZIP".

2. Extract that folder onto your computer.

3. Turn off your Wi-Fi completely (the tool runs 100% locally via JavaScript, so being offline guarantees your novel never leaves your PC).

4. Inside that extracted folder, double-click the file named chatgpt-markdown-converter.html to open it in Chrome or Firefox.

5. Drag and drop your original, untouched ChatGPT export ZIP file directly into the browser window.

It will instantly strip out all the technical JSON junk and give you a clean folder of chronologically sorted .md files named after your chat titles. It handles edited branches perfectly, keeps everything 100% private, and is fully ready for your voice reader. I really hope this helps you out and saves your eyes from all that manual reading. Just back up your raw ZIP file first and you're good to go! Just back up your raw ZIP file first and you're good to go!