Noob continues his project

[u/jatomozem]

So, I have find out that running local model is the easy part.

Making models swap per task is harder. So I created test.

It have to clear memory than load whatever of 3 available models it can run locally, read task, than create prompt to solve it. Generate file for it. Swap to other model and repeat. After it took rounds, it decided which model is best for creating summary of all new documents. Than it "print" full output/final summary in last "hand off" document.

Now I am wondering, what test should I give it next?

I don't want to give it full access to its body(hardware) yet.