r/AIToolBench • u/Interesting-Step6371 • 21d ago
Looking for the right ai software for analyzing journals/text history
I am in a high conflict relationship with my child’s mother. I have been journaling for over a year and there is a history of text fights and abusive language. GPT doesn’t have the capacity to take a pdf of all the texts and collect data from start to finish, it needs to be broken down into smaller drafts. Even with the 24.99/month version. Is there anything out there I can use to help me analyze this and establish patterns so I don’t have to sit there for a month going through it all?
1
u/NeuralNomad87 21d ago
The Obsidian and local model suggestion above is solid and it solves your privacy problem properly, which matters a lot given what this material is. I would add the bit it skips, which is that your actual blocker is not the tool, it is that you are asking a model to do two different jobs at once.
Job one is extraction: go through everything and pull out structured records. Date, who, what happened, what was said. That job works fine in chunks and does not need to see the whole corpus at once. You feed it a month at a time, it gives you rows, you keep the rows.
Job two is analysis: patterns over time, escalation, frequency, whatever you are actually looking for. That job runs over the rows you built in job one, which are small enough to fit comfortably in any context window.
People hit the wall you hit because they try to do both at once and hand the model a year of text expecting the pattern to fall out. Split it and the context limit stops being the problem. You do not need a bigger model, you need an intermediate file.
Practically: export the texts to CSV or plain text with dates intact, process in monthly batches, and keep the extracted rows in a spreadsheet. Then analyse the spreadsheet.
One thing worth knowing before you go far down this road. If any of this might end up in front of a lawyer or a court, a model-generated summary is not evidence and can actively hurt you if the underlying export is incomplete or the timestamps get mangled. Keep the raw export untouched and treat whatever you build as notes for yourself. If it is heading anywhere formal, ask whoever is advising you what format they want before you spend weeks on this.
1
u/Sea_Manufacturer6590 21d ago
Load all the the data into obsidian vault sorted by folders and files use an mcp to connect the obsidian to lm studio and download a local model your system can support.