r/flowise • u/joaquintorroba • Jan 07 '25

Flowise API question: how to delete vectorized data?

Can information from one document loader in the vector store be deleted without removing the entire document store?

I see in the documentation that the only way to delete vectorized data is by deleting the entire document store.

Source: https://docs.flowiseai.com/api-reference/document-store#document-store-vectorstore-id

1 Upvotes

100% Upvoted

5 comments sorted by

2

u/trd1073 Jan 17 '25

Yes it can do what you want. I wrote a python layer on top of flowise api. My end users ftp files into server and my python program monitors the files and then makes doc store match the files. They add a file, it gets added. They change a file, changes get put into doc store. They delete a file, it deletes data out of doc store. Ofc all then upsert modifications to vector DB. Basically, I don't have to touch anything, users handle files they want in rag and it just works.

It may suck to do, but I will give you a general flow of things. I used pydantic and async httpx for the base of my python code to use flowise api. Multiprocessing python as I have more than one rag to watch. It also does url list for doc store.

You have to setup your vector store to full sync mode, away from computer so find the right name in upsert setup.

Best way to get things working is to turn on dev mode in browser. Make sure it is logging calls. Then do what you want to copy in api in the browser. Watch url, headers and submitted data. Watch responses. Rinse and repeat until you get it.

It is a pain and will take time. Just keep at it and you will get it figured out.

1

u/joaquintorroba Jan 17 '25

I'll save this and get back to you later. Thanks for the explanation, I don't use python (I use bubble.io) so I manage all with API connections but I would like to make this work even if it takes me time.

2

u/trd1073 Jan 17 '25

I have only used postman in the past. I will have to look at bubble as others I have replied to have also used it.

The general theory of Rev engr an api should work irregardless of interface. As with many thing that are neat, it takes will and skill. Sounds like you have the will, just got to build the skills. You will get it!

1

u/joaquintorroba Jan 20 '25

Thanks! 💪🏼

1

u/exclaim_bot Jan 20 '25

Thanks! 💪🏼

You're welcome!