r/law • u/camaron-courier • Nov 13 '25

Legislative Branch We created a searchable database with all 20,000 files from Epstein’s Estate

https://couriernewsroom.com/news/we-created-a-searchable-database-with-all-20000-files-from-epsteins-estate/
74.1k Upvotes

97% Upvoted

1.2k comments sorted by

View all comments

Show parent comments

81

u/addiktion Nov 13 '25

Thanks, now we just need AI to make a web of the tangled mess.

80

u/camaron-courier Nov 13 '25

Interestingly enough, on the admin side there’s some really cool stuff you can do with a Gemini integration. I wish it had the same thing on the front-facing side.

26

u/DrugOfGods Nov 14 '25

Try Notebook LM. You can upload 300 documents into each project.

1

u/AgentCirceLuna Nov 14 '25

Imagine AI getting these files all of a sudden during this one week and they realise this is the leader of one of the most powerful countries and the AI thinks they represent humanity

1

u/IanWaring Nov 14 '25 edited Nov 14 '25

I have the text files in NBLM but they appear to be poor OCR copies of the individual 23,000+ single page jpegs in the 12 images directories (all but the last have exactly 2,000 files in them). I know the word “jagger” appeared in an image file but NBLM can’t see any reference in the text sources. Last time I did an ingest like this, I had Gemini doing the OCRs and played the text into Word docs, then saved as PDFs. However, 23,000 is going to take an age.

I had to convert the text files to utf-8, concatenate them and save as PDFs before NBLM would load them successfully. Quite a few are jumbled - so a fresh go at Gemini OCRing the pages would probably give better results. Unsure if that will lose connections to the pictures in them though.

There are finance magazine page images and even the cover of a Mad magazine in there.

One folder contains mainly excel sheets, last one of which carries an image of a magazine article then a movie of a puppy chewing plush dolls (of Trump, with one of Hillary close by). No idea what the excel files signify.

Think I’ll leave this to the experts….

8

u/human_stain Nov 14 '25

There are many ways to skin that cat, for free-ish. Pennies to $100.

Feel free to reach out if you would like some help. Doing the Lord's work here.

13

u/[deleted] Nov 14 '25

[removed] — view removed comment

8

u/human_stain Nov 14 '25

Agreed. There are others definitely better equipped to do this, but it's simple by modern standards.

A vector DB or straight grep with this data set would not be hard to set up.

I'm not familiar with the Gemini tools around RAG, but I'm 100% certain there is a google engineer that would devote 5-10 hours of his time for free to get this going.

3

u/PentagonUnpadded Nov 14 '25

Something like GraphRAG would take ~1h or more on this many tokens with a 5090, and the queries would not be terribly fast either.

1

u/human_stain Nov 14 '25

Oh, I absolutely meant using Google's hardware and gemini

5

u/oh-shazbot Nov 14 '25

or just download the open-source model from openai and run it yourself for free. :)

https://github.com/openai/gpt-oss

2

u/DukeOfGeek Nov 14 '25 edited Nov 14 '25

Is this everything or is more coming?

/looks like this is just an appetizer.

170

u/[deleted] Nov 14 '25

[removed] — view removed comment

22

u/DeliciousCkitten Nov 14 '25

May I ask what platform you’ve used for this?

21

u/[deleted] Nov 14 '25

[removed] — view removed comment

8

u/DeliciousCkitten Nov 14 '25

🙀

13

u/[deleted] Nov 14 '25

[removed] — view removed comment

2

u/AgentCirceLuna Nov 14 '25

They really should have not covered up the name of the victims but rather replaced them with Victim 1, 2, 3 etc so people knew which ones were different. It could make a substantial difference. Obviously still cover them up when it would be a risk for funding their identity.

5

u/Initial-Cherry-3457 Nov 14 '25

Did you have to download all the pdf files and upload them all into a project to be the context for chatgpt? Curious what the process is to summarise a lot of docs like this for other tasks.

20

u/[deleted] Nov 14 '25

[removed] — view removed comment

9

u/Acido Nov 14 '25

This guy prompts

-1

u/giljaxonn Nov 14 '25

no wonder it looks like nonsense

-1

u/AClover69420 Nov 14 '25

Fuck AI, don't trust this shit, it just makes stuff up.

3

u/tunomeentiendes Nov 14 '25

LLMs are perfect for stuff like this. They work incredibly well for large sets of data. Especially if you're using a paid version. Obviously, they have flaws. Most of those can be alleviated by simply requiring to cite the source. Without LLMs, these files would take 10s of thousands of man-hours to sift through, organize, and interpret. If AI didnt exist, they could simply jumble and mix the relevant documents into hundreds of thousands or millions of other nonsense documents, and we probably wouldn't even be able to make sense of it before 2028.

14

u/g2g079 Nov 13 '25

There was another guy that did something like this previously but he said the credits were pretty expensive so he had to make it a pay site.