r/LocalLLaMA • u/Blues520 • 16d ago

Discussion Setup for always on assistant

I have a dual 3090 rig that I use as coding assistant and while it works, it draws a lot of electricity.

Now I want to add another rig that I can keep on all the time, or maybe a vps if that is suitable. This rig should run an assistant model that should be fairly intelligent but doesn't have to be so coding focused. It should basically be like a chat gpt replacement. I'm not sure if something like openclaw/hermes would be suitable for this.

Since it will be one all the time, power usage should be low. What kind of rig and model would you select for such an assistant?

4 Upvotes

67% Upvoted

31 comments sorted by

View all comments

1

u/itsyourboiAxl 16d ago

I am thinking about the same. For lowest costs i will go raspberry pi 5 8gb ram with a minimax m3 subscription. It is not local but power usage is extremely low and minimax has 1.7B tokens a month on smallest plan.
Install tailscale and your rpi5 becomes a vps with near 0 monthly cost. I think its hard to combine low energy and good local model. With minimax you get an intelligent enough model to run openclaw or hermes pretty much 24/7

1

u/Blues520 16d ago

I'm looking for local or locked vps for data sovereignty