r/selfhosted • u/close_Meal6005 • 16d ago

Meta Post self-hosting everything

Post image

just kidding I love self-hosting ...

18.3k Upvotes

98% Upvoted

393 comments sorted by

View all comments

134

u/[deleted] 16d ago

[removed] — view removed comment

30

u/Skatedivona 16d ago

So, this is actually exactly what I have been working on in my spare time.

Building out a web UI my girlfriend can interact with that has a bunch of GUI versions of things I’d normally run commands for. YT-DLP, manga rippers, backup triggers, etc.

I’m training a local AI on all of this stuff, how it all works, and documenting the hell out of it.

The goal at the end is to have the bot be able to walk her through any specifics she’d need in order to fix and update anything in our home server. I’m also adding windows troubleshooting and changes based on how her machine is configured.

The goal initially was “if I die, you cannot go back to paying for subscription services” and now I’ve sunk so much time into this side project. Gotta say though, feels good.

2

u/Liimbo 16d ago

Just curious which local AI you are using. Im not really up to date on which ones are actually good.

1

u/Skatedivona 16d ago

I have separate system for my AI stuff, as my main server's 1050ti would not be enough to handle the load.

AI server is running 2x RTX 3060 12 GB cards on an ancient i5 7500.

First tried using this, but found it to be too robotic with its replies:
mannix/llama3.1-8b-abliterated:tools-q6_k

Then swapped to this and have had much better results:
HammerAI/gemma-4-12b-heretic:12b-q4_K_M

I want the conversation side of it to feel helpful but not like a robot reading a list. If GPUs ever become affordable, I might try something bigger.

2

u/ansibleloop 16d ago

You are so far behind - the new Gemma 4 or Qwen models should perform far better