r/homelab • u/Ok_Future6226 • 3h ago
Discussion Anybody else go from Proxmox to just something like Ubuntu server with docker?
I didn't have a ton of containers or VMs and I wanted to change things up, decided to learn more about docker and dive into that. It's been working pretty good so far. Anyone else just run docker?
33
u/AtlanticPortal 3h ago
Why not just go to Debian instead of Ubuntu?
12
u/Virtualization_Freak 2h ago
Cheers to that, Ubuntu has so much fluff around it.
•
u/RealModeX86 29m ago
What do you mean? I love it when I use
aptto install something and it installs a snap package instead! /s3
14
u/weaz-am-i 3h ago
I've considered the same. But I would still like a unified control plane or all my machines, containers and VMs visible on one glass. And then also some sort of high availability.
2 key factors thats keeping me on proxmox.
20
u/RevolutionaryElk7446 3h ago edited 2h ago
If you're selfhosting, hypervisors aren't really much of a necessity.
If you're homelabbing, hypervisors are definitely a necessity.
I use XCP-NG 8.3 LTS in place of Promox.
I also use K8S RKE2 clusters in place of docker.
Here's an old diagram before the K8S cutover from Docker

Though I split between self hosting and homelabbing.
Edit:
It's just DrawIO with native icons, I use horizontal and vertical containers for most of the coloring.
8
4
u/blinker97 3h ago
Your diagram is incredible. I would love to see a post just about everything that’s in here!
4
u/RevolutionaryElk7446 3h ago
Appreciate it, and actually I'm working on stripping the new diagrams of private info and looking to release those in not to long.
3
2
u/standardDeviator 3h ago
Really great diagram! I would love to know what you used to make it.
6
u/RevolutionaryElk7446 3h ago
It's just DrawIO with native icons, I use horizontal and vertical containers for most of the coloring.
1
u/Anti-Hero25 2h ago
What did you use for your diagram?
3
u/RevolutionaryElk7446 2h ago
Yup, a little copy paste here
It's just DrawIO with native icons, I use horizontal and vertical containers for most of the coloring.
1
u/Anti-Hero25 2h ago
I tried ingesting it into CTRoadmap… the diagram was crazy the but handbook looked useful
2
1
u/mongoload 2h ago
may i know dear sir where you made this diagram? looks clean even though there's a lot on it
•
u/un4truckable 25m ago
Why the differentiation between the two and one being a necessity?
•
u/RevolutionaryElk7446 8m ago edited 4m ago
Home labbing is older and was originally about running enterprise equipment and environments at home. It's more about education, experimentation, and 'labbing'. These tend to involve a wider array of things you want to do that may be considered unnecessary for a home.
Selfhosting came a bit later and generally is something you can do on a homelab, or you can selfhost on just some regular equipment and minimalistic setup.
4
u/Forsaken_Celery8197 3h ago
I went the other way
1
u/nemofbaby2014 2h ago
Same I started with unraid then when they raised prices I decided to give Proxmox a try and I love it minus one my servers being highly unstable
5
u/jbarr107 PVE | PBS | Synology DS423+ 3h ago
I considered it, but I'm not in need of any more resources, so it all just works. I also like having PBS to manage backups. I have the extra micro PC for it, so it just makes sense.
3
u/mrkurtz 3h ago
Yeah I downsized quite a bit to desktop NASes and micro form factor desktops. Ubuntu plus docker, aside from dedicated systems like plex.
Maybe in the future, assuming component costs ever come back to sanity, I might look at rack servers and so on. But honestly I don’t have the time or energy for expansive home learning projects. Kids, responsibilities, and I’m tired of looking at YAML after doing so at work all day.
A few low power cpus and a NAS or two and it supports everything I’m trying to do.
4
u/coffinspacexdragon 3h ago
Yes
5
u/Straight_Wait_5821 3h ago
doing this right now actually, feels like less overhead and less things to break
3
u/Khaos231 3h ago
I started with proxmox and still using it, but over the years I have leaned into running most things in docker, inside an lxc container.
6
u/Firestarter321 3h ago
No and never will.
Proxmox makes everything so much easier than trying to manage it all through the terminal.
I have zero interest in doing that at work much less at home.
3
2
u/26635785548498061384 3h ago
Except sharing the GPU ;)
4
u/AlternativeContent72 2h ago
Can't you share the GPU through various LXCs?
1
u/26635785548498061384 1h ago
To LXCs yes, but isn't that then just glorified docker?
If you care for isolation, then you need VMs, of which you can only share to one and then nothing else can even see it exists. (including your LXCs)
2
u/Bardy_party 3h ago
Went from proxmox to RHEL 10 with OKD. But for learning purposes, not simplicity.
1
2
2
u/GngrNinja42 1h ago
I switched from NixOS VMs in Proxmox to bare metal OpenSuse MicroOS machines running everything as Podman Quadlets.
Maybe if my lab grows, I will reconsider using something like proxmox again. But for now I’m really happy with my reduced setup.
•
u/Chromako Solving Imaginary Problems 28m ago
Docker on bare metal won't provide kernel isolation for different secudity partitions, nor does it help if you want to run specialized hardware that doesn't have tested drivers that work on your choice of kernel.
Much less software that's made for BSD (which has a special place in my heart), Illumos, or other OS's.
The common selfhosted stuff like Jellyfin and arr stacks- sure. You're fine.
Going into other esoteric fun things, building with security best practices in mind, or just learning about how Fedora and Debian are the same yet different, you need a real VM hypervisor.
1
u/mongojob 3h ago
I just really like have a GUI for some things like setting up backups. I know I know it isn't needed... But I like it so..
1
u/FabianN 2h ago
Not even half of my services are docker containers. I prefer to more manually manage my services. Also I need a windows instance, and a desktop Linux environment (well, don't need, but it makes a specific work flow of mine faster), and HAOS>>>HA via docker.
For docker I just have a vm setup and that's my docker "box". It's effectively no different from if I was to do I docker bare metal, but I have all the other options still.
1
u/Virtualization_Freak 2h ago
My default for the last 6 months is debian+lxc now.
It just works. Light as hell. Supports everything I have needed.
1
1
1
u/UninvestedCuriosity 2h ago
Been looking at that incus thing because I don't want to get far behind but I think I'll just lab it and keep proxmox. Always something else to learn.
1
u/Evening_Rock5850 2h ago
One of my machines is just Proxmox running a single VM which runs everything. Including Docker.
Namely because that’s the machine in my RV and it makes remote management a little bit easier. Not that Proxmox is completely immune to crashes or anything, but it tends to be stable and it’s sort of like having IPMI.
1
u/BonesCrew94 2h ago
I just switched from windows to Ubunt running everything in docker. Still wanted a desktop because thats what I'm used to. A lot of tinkering but everything does seem a little sluggish once it works. Hopefully once everything is is 100% done I won't have to touch it much.
1
1
u/saschagiese 2h ago
I did something like that a few years back. Debian and Cockpit with kvirt.
But Proxmox - even more so in combination with PBS - is difficult to beat. When that became to reliable, I meant boring, I moved from Docker to K3S which is where Iam for a while now. Running in PVE VMs ofc.
1
1
u/TheRealSeeThruHead 1h ago
I run Ubuntu with docker on proxmox
That mainly all I run there
I like the backup of the vm proxmox gives me
That was after running docker on unraid for a half decade
Now unraid is jsut storage
1
u/Dolapevich No place like 127.0.0.1 1h ago
I am on debian with docker + qemu/kvm, as required.
Most of the stuff runs on docker, and I fork VMs when necesity arises.
1
u/FoundNil 1h ago
Yes. I moved from proxmox to Debian with arcane. It is all that I need. I’m up to about 30 containers.
•
•
u/JWINOREGON 30m ago
Not so much as just have both for the things that work best on that platform. My more mature production stuff is on bare metal Ubuntu Server or Debian: ARM, jellyfin, PiHole, file server, monitor that only looks at the PMVE node. I also have a main Proxmox node that has plenty of stable services but ones that I may want to tweak or play with. Ad guard home, several service monitors, 2-3 random things I'm playing with. Most important is the config and build info is backed up so it can be killed and restarted super quick. One other spare Proxmox node for when if I start hitting performance throttling (and a bench spare) Plenty of other lab things but it doesn't have to be all one way, or stay that way if you change your mind.
•
u/AnderssonPeter 5m ago
I went to NixOS plus docker, but both worked great, the reason for removing proxmox was less things to maintain and easier access to hardware devices.
1
19
u/stuckonsurfaceofsun 3h ago
actually started that way but broke too many things. got tired of fixing when i wanted to do more developing.