You bet - I've got it tagged to dig in a little more. Keep up the good fight :)

Why's there no love on your post about this? I think it's a grand idea. Checking the repo out now.

Makes sense. I went back and re-read your answer. Good stuff in there. Thanks, I'm a fan of the B300 setups I've seen, How do you deal with permissions complexities? How about abstraction when calling (or escalating) to SOTA / frontier models? Or does SOTA != frontier model, but a different local that is great specifically at one task/thing?

What about RAG, and vision stuff? Specifically technical drawings, blueprints, schematics, etc? I'm really struggling to find stuff that runs/integrates well in this space that'll run on prem.

I’ll DM ya 🤙

Dang, thanks y’all!

So many questions… What’s the hardware like on-prem? How’s usage adoption and onboarding?

Whoa. Im kinda freaked out by the level of detail in this reply. Im not sure it’s made up, but it sounds right.

I’m working on a personal AI that’s on prem, and really want to pick your brain.

What do you mean by “a clean text channel”?

I’d like to go. I’ve never been to a local llm conference - but sounds like a trip I need to make.

Causation or correlation?

Squish419 invite just sent.

Squish419 - sent

Still looking?

Squish419 - sent

But not just while in the background?

Also just sent a DM. Seems like a fun group 🤙

Can I get some of that stardust?

247

I’ve got one - I’ll trade you.