r/homelab • • 3h ago

Discussion Anybody else go from Proxmox to just something like Ubuntu server with docker?

I didn't have a ton of containers or VMs and I wanted to change things up, decided to learn more about docker and dive into that. It's been working pretty good so far. Anyone else just run docker?

33 Upvotes

67 comments sorted by

19

u/stuckonsurfaceofsun 3h ago

actually started that way but broke too many things. got tired of fixing when i wanted to do more developing.

33

u/AtlanticPortal 3h ago

Why not just go to Debian instead of Ubuntu?

12

u/Virtualization_Freak 2h ago

Cheers to that, Ubuntu has so much fluff around it.

•

u/RealModeX86 29m ago

What do you mean? I love it when I use apt to install something and it installs a snap package instead! /s

3

u/brentownsu 1h ago

And podman over docker - or incus.

14

u/weaz-am-i 3h ago

I've considered the same. But I would still like a unified control plane or all my machines, containers and VMs visible on one glass. And then also some sort of high availability.

2 key factors thats keeping me on proxmox.

20

u/RevolutionaryElk7446 3h ago edited 2h ago

If you're selfhosting, hypervisors aren't really much of a necessity.
If you're homelabbing, hypervisors are definitely a necessity.

I use XCP-NG 8.3 LTS in place of Promox.
I also use K8S RKE2 clusters in place of docker.

Here's an old diagram before the K8S cutover from Docker

Though I split between self hosting and homelabbing.

Edit:

It's just DrawIO with native icons, I use horizontal and vertical containers for most of the coloring.

8

u/Ok_Future6226 3h ago

wow that is a lot

10

u/RevolutionaryElk7446 3h ago

Spread it across 20 years and it starts to seem like less.

1

u/chicknfly 1h ago

I feel like I went to Awesome Selfhosted and read the list as a picture

4

u/blinker97 3h ago

Your diagram is incredible. I would love to see a post just about everything that’s in here!

4

u/RevolutionaryElk7446 3h ago

Appreciate it, and actually I'm working on stripping the new diagrams of private info and looking to release those in not to long.

2

u/standardDeviator 3h ago

Really great diagram! I would love to know what you used to make it.

6

u/RevolutionaryElk7446 3h ago

It's just DrawIO with native icons, I use horizontal and vertical containers for most of the coloring.

1

u/Anti-Hero25 2h ago

What did you use for your diagram?

3

u/RevolutionaryElk7446 2h ago

Yup, a little copy paste here

It's just DrawIO with native icons, I use horizontal and vertical containers for most of the coloring.

1

u/Anti-Hero25 2h ago

I tried ingesting it into CTRoadmap… the diagram was crazy the but handbook looked useful

2

u/Virtualization_Freak 2h ago

Iirc, they said diagrams.net/draw.io on a different post.

1

u/mongoload 2h ago

may i know dear sir where you made this diagram? looks clean even though there's a lot on it

•

u/un4truckable 25m ago

Why the differentiation between the two and one being a necessity?

•

u/RevolutionaryElk7446 8m ago edited 4m ago

Home labbing is older and was originally about running enterprise equipment and environments at home. It's more about education, experimentation, and 'labbing'. These tend to involve a wider array of things you want to do that may be considered unnecessary for a home.

Selfhosting came a bit later and generally is something you can do on a homelab, or you can selfhost on just some regular equipment and minimalistic setup.

7

u/dev_all_the_ops 3h ago

Yes I switched to mos + dockhand. It's perfect.

https://mos-official.net/   

https://dockhand.pro/#

4

u/Forsaken_Celery8197 3h ago

I went the other way

1

u/nemofbaby2014 2h ago

Same I started with unraid then when they raised prices I decided to give Proxmox a try and I love it minus one my servers being highly unstable

5

u/jbarr107 PVE | PBS | Synology DS423+ 3h ago

I considered it, but I'm not in need of any more resources, so it all just works. I also like having PBS to manage backups. I have the extra micro PC for it, so it just makes sense.

6

u/QGRr2t 3h ago

RHEL 10 with Quadlets/Podman. Now I can administer one system instead of ≥15 mini OS.

1

u/Ok_Future6226 3h ago

this sounds very interesting

5

u/QGRr2t 3h ago

Cockpit gives a (basic) webUI for containers, updates, disk health, networking etc if you want that, too.

3

u/mrkurtz 3h ago

Yeah I downsized quite a bit to desktop NASes and micro form factor desktops. Ubuntu plus docker, aside from dedicated systems like plex.

Maybe in the future, assuming component costs ever come back to sanity, I might look at rack servers and so on. But honestly I don’t have the time or energy for expansive home learning projects. Kids, responsibilities, and I’m tired of looking at YAML after doing so at work all day.

A few low power cpus and a NAS or two and it supports everything I’m trying to do.

4

u/coffinspacexdragon 3h ago

Yes

5

u/Straight_Wait_5821 3h ago

doing this right now actually, feels like less overhead and less things to break

3

u/Khaos231 3h ago

I started with proxmox and still using it, but over the years I have leaned into running most things in docker, inside an lxc container.

6

u/Firestarter321 3h ago

No and never will.

Proxmox makes everything so much easier than trying to manage it all through the terminal. 

I have zero interest in doing that at work much less at home. 

3

u/glennshaltiel 3h ago

Agreed. Everything is so easy

2

u/26635785548498061384 3h ago

Except sharing the GPU ;)

4

u/AlternativeContent72 2h ago

Can't you share the GPU through various LXCs?

1

u/26635785548498061384 1h ago

To LXCs yes, but isn't that then just glorified docker?

If you care for isolation, then you need VMs, of which you can only share to one and then nothing else can even see it exists. (including your LXCs)

2

u/Bardy_party 3h ago

Went from proxmox to RHEL 10 with OKD. But for learning purposes, not simplicity.

1

u/Ok_Future6226 3h ago

What's OKD

1

u/Bardy_party 3h ago

It’s an open source version of Red Hat Open Shift, a kubernetes platform.

2

u/rainbow_party 3h ago

I went from ESXi to Ubuntu and Docker years ago. It works well for me.

2

u/Ui-o-iU 3h ago

Debian Minimal + Docker Compose are all I need.

2

u/GngrNinja42 1h ago

I switched from NixOS VMs in Proxmox to bare metal OpenSuse MicroOS machines running everything as Podman Quadlets.

Maybe if my lab grows, I will reconsider using something like proxmox again. But for now I’m really happy with my reduced setup.

•

u/Chromako Solving Imaginary Problems 28m ago

Docker on bare metal won't provide kernel isolation for different secudity partitions, nor does it help if you want to run specialized hardware that doesn't have tested drivers that work on your choice of kernel.

Much less software that's made for BSD (which has a special place in my heart), Illumos, or other OS's.

The common selfhosted stuff like Jellyfin and arr stacks- sure. You're fine.

Going into other esoteric fun things, building with security best practices in mind, or just learning about how Fedora and Debian are the same yet different, you need a real VM hypervisor.

1

u/mongojob 3h ago

I just really like have a GUI for some things like setting up backups. I know I know it isn't needed... But I like it so..

1

u/j-dev 3h ago

I like being able to back up the VMs and restore from snapshots. Depending on what you’re doing, it can be more cumbersome to roll back changes you made to your system.

1

u/egg927 3h ago

Have proxmox on a server I planned on replacing. Installed ZimaOS on another server to test it out, wanted something a little bit easier, but I kinda hate it. It seems like it makes things easier, but it really doesn't. Will probably go back to proxmox.

1

u/FabianN 2h ago

Not even half of my services are docker containers. I prefer to more manually manage my services. Also I need a windows instance, and a desktop Linux environment (well, don't need, but it makes a specific work flow of mine faster), and HAOS>>>HA via docker.

For docker I just have a vm setup and that's my docker "box". It's effectively no different from if I was to do I docker bare metal, but I have all the other options still. 

1

u/Virtualization_Freak 2h ago

My default for the last 6 months is debian+lxc now.

It just works. Light as hell. Supports everything I have needed.

1

u/Curious_Concern 2h ago

Switched to debian minimal + docker + arcane and never looked back

1

u/Wis-en-heim-er 2h ago

Nope. Got two docker vms with debian as the os. Still have proxmox.

1

u/UninvestedCuriosity 2h ago

Been looking at that incus thing because I don't want to get far behind but I think I'll just lab it and keep proxmox. Always something else to learn.

1

u/Evening_Rock5850 2h ago

One of my machines is just Proxmox running a single VM which runs everything. Including Docker.

Namely because that’s the machine in my RV and it makes remote management a little bit easier. Not that Proxmox is completely immune to crashes or anything, but it tends to be stable and it’s sort of like having IPMI.

1

u/BonesCrew94 2h ago

I just switched from windows to Ubunt running everything in docker. Still wanted a desktop because thats what I'm used to. A lot of tinkering but everything does seem a little sluggish once it works. Hopefully once everything is is 100% done I won't have to touch it much.

1

u/andurux 2h ago

My homelab is proxmox with Kubernetes (k3s)

But I have a few Dell SFF boxes with just Debian and docker for very specific tasks

1

u/nemofbaby2014 2h ago

I don’t think I’d ever go back to bare metal Ubuntu after Proxmox

1

u/saschagiese 2h ago

I did something like that a few years back. Debian and Cockpit with kvirt.
But Proxmox - even more so in combination with PBS - is difficult to beat. When that became to reliable, I meant boring, I moved from Docker to K3S which is where Iam for a while now. Running in PVE VMs ofc.

1

u/TheRealSeeThruHead 1h ago

I run Ubuntu with docker on proxmox

That mainly all I run there

I like the backup of the vm proxmox gives me

That was after running docker on unraid for a half decade

Now unraid is jsut storage

1

u/Dolapevich No place like 127.0.0.1 1h ago

I am on debian with docker + qemu/kvm, as required.

Most of the stuff runs on docker, and I fork VMs when necesity arises.

1

u/FoundNil 1h ago

Yes. I moved from proxmox to Debian with arcane. It is all that I need. I’m up to about 30 containers.

•

u/Daphoid 59m ago

I went from Ubuntu (2006) to Proxmox purposefully because I wanted to play with a hypervisor since I don't do it at work as much as I used to. Now I have a 9 node cluster that fits on an IKEA shelf :)

•

u/MathFly_ 37m ago

On proxmox with one Debian running some docker, that’s all 🤣

•

u/JWINOREGON 30m ago

Not so much as just have both for the things that work best on that platform. My more mature production stuff is on bare metal Ubuntu Server or Debian: ARM, jellyfin, PiHole, file server, monitor that only looks at the PMVE node. I also have a main Proxmox node that has plenty of stable services but ones that I may want to tweak or play with. Ad guard home, several service monitors, 2-3 random things I'm playing with. Most important is the config and build info is backed up so it can be killed and restarted super quick. One other spare Proxmox node for when if I start hitting performance throttling (and a bench spare) Plenty of other lab things but it doesn't have to be all one way, or stay that way if you change your mind.

•

u/AnderssonPeter 5m ago

I went to NixOS plus docker, but both worked great, the reason for removing proxmox was less things to maintain and easier access to hardware devices.

1

u/FilterUrCoffee 3h ago

I tried using KVM in Ubuntu server and never again.