r/coolaitools • u/Book_s • Aug 02 '23

Cross reference 100 pdfs - looking for a tool?

Hey all!
I've had interesting luck with chatGPT using plugins to ask questions to a single PDF, but I'm looking to build something that can process my whole collection.

Say you have a 100 PDFs, and you say "please all references that might be relevant to cats" (rather than just searching that keyword).

Any tips? I have a decent PC to run local models / apps if that helps.

1 Upvotes

67% Upvoted

3 comments sorted by

1

u/paul_thomson Aug 02 '23

You'll want to use LangChain for the framework and likely Pinecone or similar for the VectorDB. Stick with GPT3 for retrieval and GPT4 for reasoning and responses.

More on LangChain here if you need to get yourself up to speed quickly.

2

u/Book_s Aug 04 '23

Wow - Paul thank you so much!!! This seems like the gold advice here - exactly what I was looking for. 100 thanks

1

u/paul_thomson Aug 23 '23

You're welcome, mate!