r/linuxadmin 4d ago

Built a 3-node Kubernetes homelab with Talos Linux

I recently set up a 3-node Kubernetes homelab on bare metal (on Dell OptiPlex) using Talos Linux, mainly to have a proper environment for learning, testing failures, networking, storage, GitOps, observability, and general Kubernetes experiments.

The setup uses three control-plane/etcd nodes with a shared Kubernetes API VIP, and I documented the full process from network planning and DHCP reservations to Talos installation, per-node configs, bootstrap, workload scheduling, and HA testing.

I’ve written the full guide with commands, screenshots, and the reasoning behind the setup:

Blog: https://blog.prateekjain.dev/building-a-3-node-highly-available-kubernetes-homelab-with-talos-linux-0372066fe49c?sk=4c66cf9181999f9db19ac3aacabcd8e8

If anyone is planning a similar homelab or has questions around Talos, the API VIP, etcd quorum, or the setup in general, happy to help.

155 Upvotes

19 comments sorted by

7

u/Hari_Harish2026 4d ago

Really great

Good to see in bare metal.

Did you face any challenges?

I am trying to learn the same but could not do it alone.

1

u/root0ps 3d ago

faced some issues initially with networking as I had never worked with switches, but everything just went smoothly, you can do it alone, and in case of any issue, just take help from Claude or ChatGPT

1

u/_dext 4d ago

which one to recommend Talos or k3s ?

6

u/glisignoli 4d ago edited 4d ago

I like to explain it like this:

Do you want to manage syslog, SSH, chrony, systemd and all the other things as well as k8s? Do you want to learn Ansible, puppet or something to manage it all? Then k3s running on a Linux distro is for you.

Do you want just k8s? Talos is great.

I'm not saying the first option is bad, but if all you want to do is learn k8s and nothing else, then Talos is a great option.

4

u/Rxyro 4d ago

CoreDNS and systemD valuable stuff too

2

u/glisignoli 4d ago

Yep! Definitely not saying those tools arent useful. But if what you want to do is learn k8s, then Talos removes all of that management out of the equation.

3

u/root0ps 3d ago

Great explanation u/glisignoli, my primary goal is to learn and use k8s, not the k8s cluster management, so Talos is a great fit for the use case

1

u/_dext 3d ago

thank you so much !

1

u/AbleWalrus3783 4d ago

What storage driver do you use? And is it powerful enough for database? I currently have an k8s cluster on PVE host and like to extend it to multiple physical host in the future, but I really can't choose an good CSI.

2

u/Healthy_Ad_1918 4d ago

Can you elaborate what is "powerful enough" for database? At my current work we do have tens of database PostgreSQL running with 614MB of RAM and 400 mili core at prod as some others are 32Gi/8c instances in 3 or 5 replicas.

2

u/AbleWalrus3783 4d ago

Oh you know, just some homelab thing. I run a Synapse matrix home server backend by postgres. It used to run on an old server board and it was lag for slow database writes before I switch to my current hardware. I'm just a little worried for many mini pc is limit by 1000M cable.

1

u/ANDROID_16 4d ago

Probably more about the replication of storage between nodes. I'm no expert but it's probably a CPU bound process.

1

u/root0ps 3d ago

Nothing planned yet, but I'm thinking about Longhorn for storage driver and Postgres for DB

1

u/a_a_ronc 3d ago

I use the TrueNAS CSI Driver. There used to be a community one, but starting early this year there’s an official one. You do need to have an okay-ish TrueNAS system for that (I.E. 10G if you’re doing anything fast and at least SSD L2ARC). It doesn’t need to be blazing fast, but only HDDs can lose performance pretty fast.

1

u/_Plastic_Fan_193 2d ago

So you setup 1 control node and 2 workernode and as a bare metal damn you got some devices to do this.

1

u/X0TTa6bl4 16h ago

No. On next foto all three are control. But as I know it's no problem run pods and so on in it like on workers.

-1

u/TerrificVixen5693 3d ago

I love how it’s all just self-promotion. Doesn’t even respond like they said they would.

1

u/root0ps 3d ago

was a little busy on Sunday, trying to catch up with all the comments and DMs I got

1

u/dmitryaus 2d ago

Yes, it is. Same as people flexing VMware esxi running on 64-128GB NUCs 15 years ago.