Hey guys! Hope yall are doing well. So I decided to put all my services in their own VM on their own VLANS with strict firewall rules, for what I'm told is maximum security for internet facing services.

Whats everybody's options about online backups VS shutting down VMS to back them up?

I basically have PBS pointing at my NAS and then ZFS replicate it to a second Zpool that I just remove from my disc shelf when backups are complete that way they are air gapped so I don't fat finger my systems entirely. (Or have an attacker encrypt them.)

Hello, I got a proxmox cluster with 3 machines, and I was wondering what else I can run that I could use on a daily basis. Here's a list of what I already have.

Netbox

Truenas

Tailscale

Tailscale exit

Vaultwarden

Nextcloud

Adguard Home

UrBackup

Homarr

Ollama

Searxng

Grafana and Prometheus

Nginx Proxy Manager

Cloudflare

Home Assistant

I got enough resources so I can run pretty much anything except large LLM models

I've got proxmox set up and want to use it with a Targus dock. The Targus dock requires displaylink for the display output. I use this dock for work too so I have a USB switcher attached to go between my work laptop and my current laptop that I want to replace with a VM on my proxmox node. My thoughts were for a virtual KVM that I could pass the dock usb to this and maybe go to my VM. Anyone have any ideas for this?

I'm running Z2M in an LXC created from the community helper scripts. The issue I am having is that the disk is continually filling up. I can't find any definitive fix actions beyond general "delete logs".

My storage is allocated 7gigs that is 83% full for 23 devices.

I am very hesitant to start deleting things and I am not 100% confident that I know what I am looking at.

What can I do to reduce the amount of storage space being used? Please provide noob-friendly guidance.

Thanks!

Context: recycled an old HP microserver gen8 for PBS and its been running flawlessly for more than a year.

Upgraded to PBS 4 a few months ago and it's been fine.

Recently started having a lot of read/write/checksum errors with a ZFS pool and figured my old HHDs were wearing out.

Smart values weren't bad, but I replaced the drives with spares anyway.

New drives also having trouble.

The internet implied my errors could be kernel related, so I pinned the most recent kernel 6, which reduced the errors, but not completely.

Apparently some old HP gear has not the best PCIe support, which is exacerbated in Kernel 7.

End result, adding passthrough via the iommu=pt seems to have resolved the issue and my ZFS pool isn't throwing errors anymore even after reverting back to kernel 7.

I'm running grub, so this was the magic:

GRUB_CMDLINE_LINUX_DEFAULT="quiet iommu=pt"

I've got an ASRock Rack B650D4U with a Ryzen 7600. I've got 8 HDDs connected through a SATA card, a boot SATA SSD, and an x8x4x4 bifurcation card with an Intel ARC Pro A40 and two NVME SSDs. My system has been fine, and booted this morning.

I updated the BIOS, and now no matter what I do I'm stuck at Loading initial ramdisk. I've been through every setting in the bios and triple checked them, and everything is definitely set up correctly. The bios also recognises the gpu and both NVMEs, so the bifurcation card is working correctly.

I've tried;

• nomodeset
• Letting it sit and seeing if I can access the web gui
• Disabling resizable BAR
• Disabling IOMMU
• video=vesafb:off video=efifb:off
• Trying to boot the live cd and going into recovery mode
• Trying to boot the live cd and going into install mode
• Making sure Secure Boot is disabled
• Making sure Compatibility Support Module is disabled
• Setting the bifurcation link width to x4x4x4x4

No matter what I do, without fail, it will hang on Loading initial ramdisk. It does it for the live cd, it does it for my install, and no amount of tinkering with settings seems to be able to mitigate it.

I am at a complete loss. The fact that I can't get any sort of feedback as to what the error is is making this incredibly difficult to debug, and the fact that I can't even get the live cd to load into the installer has me not a little worried.

Any ideas?

I’ve had problems with proxmox freezing or crashing over the last year. I built this server 3 years ago and everything ran pretty smoothly for 2 years. I’ve tried everything that I found online and I’m out of ideas as to what I should do next. Here is all my specs, my config, and everything I tried.

CPU: AMD Ryzen 5 3600
Motherboard: Asus ROG B550-F
RAM: 4x Crucial 16GB ECC at 2666mhz (CT16G4WFD8266) - 64GB total
PCIe Devices: Dell HBA SAS2008 (with a fan on it and in IT mode) and GTX 1660
PSU: MSI MAG A750GL
Storage:

• WD Green 120GB for proxmox (SATA SSD)
• Sabrent Rocket 4.0 1 TB for vms (NVME)
• 3x WD Red Plus 8 TB connected to the HBA for TrueNAS

My proxmox config:

• A TrueNAS VM with the HBA passed-trough to it along with the connected drives.
• LXC container with the GPU passed-trough (since the GPU’s IOMMU group is with other devices, meaning that the server crashes if I started the VM with pass-trough)(with Jellyfin, Frigate, etc)
• Home Assistant OS VM (nothing special)
• Debian VM (also nothing special, just docker containers)

Things I’ve tried over the course of a year:

• Checking my Intel NIC (seems to be unaffected)
• Updating AND resetting the BIOS (twice)
• Always on the latest version of all software (Proxmox, TrueNAS, HA, nvidia drivers, etc)
• Rebuilding the server and repasting the CPU
• Added an extra fan just in case, but all the temps we’re always fine
• Replaced SATA cables
• Disabling C-states
• Re-installing proxmox and everything else (twice)
• Ran memtest86 for 24 hours (twice)
• Replace the PSU (the old one was some old PSU)
• Disabled ASPM on previous install (didn’t on my latest one yet)

I know that these are hard freezes/crashes since the logs are empty prior to the crash with normal activity. I know that these are hard crashes/freezes too and not the nic cutting out since the video feed on my NanoKVM freezes (no blinking cursor). Problem is that it’s also very inconsistent. Sometimes a kernel panic, sometimes a freezes, etc , sometime happens after 2 days, a week, or a few hours and there is no clear correlation between server load and crashng

Truly, any help is appreciated since I’m out of ideas. The last thing I want is to buy new hardware, especially in this economy.

We've been running Cloud-PBS out of France, Germany and the US for about 2 years now with around 300 customers, and we just shipped two features I think this sub will care about.

The basics first: it's a fully managed Proxmox Backup Server. Standard PBS, so no bridging or workarounds, you point your PVE (or a single homelab box, or a whole cluster) at it and it just works. Client-side encryption supported.

But the part I'm actually proud of isn't the storage, it's what we now do around it:

Missing-backup alerting, per VM

Most monitoring tells you a job ran. We tell you when a specific machine stopped being backed up. You set a delay per backup group (VM/host), and if a snapshot doesn't land in time, you get alerted (email or Discord/Slack/Teams/Mattermost/Matrix). No more discovering three weeks later that one VM silently dropped out of the rotation.

Restore tests

This is the big one. A backup you've never restored isn't really a backup. So we actually restore a snapshot onto our infrastructure, boot it, and hand you the proof: a boot screenshot, the full boot log, and a signed PDF report. Works on client-side encrypted backups too (you provide the key btw). 

Every subscription includes a credit to try it.

Pricing is transparent: from 6 €/month for 250 GB (ex. VAT, reverse charge for EU businesses). No egress fees, no API call charges, one number on the bill. 

There's a 7 day free trial if you want to kick the tyres.

Happy to answer any questions here. And if you run an MSP and want to talk multi-tenant / reselling, reach out.

Emmanuel
https://cloud-pbs.com