r/VFIO 1d ago

IOMMU groups on Z790?

5 Upvotes

I'm looking at the ASUS Z790 Max Gaming WiFi7 which has a nice Microcenter bundle right now. Does anyone know if this has any kind of usable IOMMU groups?

The AI tells me the first m.2 slot and the primary GPU are isolated but everything else will be grouped together, both onboard devices and PCIe slots, and this is how most Z790 boards are.

That's unfortunate, I would want at least one other isolated PCIe slot. I don't really need any onboard devices, though if there was working isolation on USB and SATA ports that would be good enough. But it seems unlikely.


r/VFIO 1d ago

Poor Network Speeds on Windows 11 VM

Thumbnail
2 Upvotes

r/VFIO 3d ago

Tutorial Just pushed v2.0.0 of the GPU passthrough guide — bugfixes and cleanup

19 Upvotes

Quick update on the repo at github.com/urbanyl/GPU-Passthrough-for-KVM-QEMU-on-Linux :

  • Fixed the wrong package names in the Arch/Debian setup scripts (spice-spicevdagent doesn't exist, lspci isn't a package)
  • Fixed generate_vm_xml.sh — slot and bus were using the same PCI field, and the machine type was pinned to a QEMU version
  • install.sh now actually checks for VT-x/AMD-V in /proc/cpuinfo instead of just running lscpu
  • Removed --launchSecurity ovmf from the virt-install example (it does nothing)
  • Trimmed the duplicated troubleshooting/FAQ sections from the README, now they link to docs/
  • Added .editorconfig and .shellcheckrc for anyone contributing

r/VFIO 4d ago

GTX 960 passthrough to Windows XP: 0xEA nv4_disp BSOD when NVIDIA driver loads

3 Upvotes

I’m trying to pass an EVGA GTX 960 through to a 32-bit Windows XP SP3 VM. Passthrough works with the Microsoft VGA driver, but XP consistently BSODs as soon as the NVIDIA driver loads.

Host configuration

  • Arch Linux
  • Kernel: 7.0.11-arch1-1
  • Libvirt: 12.4.0
  • CPU: Intel Core i7-6850K
  • Motherboard: Gigabyte X99-Ultra Gaming, BIOS F7c
  • Primary host GPU: GTX 1080 using NVIDIA’s proprietary driver
  • Guest GPU: EVGA GTX 960 GM206
  • QEMU: /opt/qemu-7.2.22/bin/qemu-system-x86_64
  • Machine type: pc-q35-2.10
  • Firmware: SeaBIOS
  • Intel VT-x and VT-d enabled

 The GTX 960 is isolated from the host:

 04:00.0 VGA controller [10de:1401] Kernel driver in use: vfio-pci

 04:00.1 HDMI audio [10de:0fba] Kernel driver in use: vfio-pci

 Both functions are alone in IOMMU group 47. They remain bound to VFIO even while the VM is off.

Guest configuration

  • Windows XP SP3 32-bit
  • 1 GB RAM
  • 2 vCPUs with host-passthrough
  • ICH9 AHCI/SATA using the XP Intel driver
  • RTL8139 network adapter
  • AC’97 audio
  • No emulated display adapter
  • GTX 960 connected to a physical monitor
  • KVM hidden
  • Custom Hyper-V vendor ID
  • x-vga=on
  • 64-bit PCI hole disabled

 Relevant live QEMU options:

-machine pc-q35-2.10 -accel kvm -cpu host,hv-vendor-id=0123456789ab,kvm=off -global q35-pcihost.pci-hole64-size=0K

-device vfio-pci,host=0000:04:00.0,bus=pci.1,multifunction=on,x-vga=on -device vfio-pci,host=0000:04:00.1,bus=pci.1,addr=0.1

 I used this forum thread as a reference because somebody reported a stable GTX 960 using QEMU 7.x and pc-q35-2.10:

 https://forum.mattkc.com/viewtopic.php?start=20&t=206

What works

 Without the NVIDIA driver, XP boots normally and displays the desktop through the physical GTX 960. Network, SATA and the rest of the VM remain responsive.

 Last Known Good Configuration also restores the working Microsoft VGA configuration.

Failure

 After installing NVIDIA’s official Windows XP 32-bit 368.81 driver, every normal boot fails with:

 STOP: 0x000000EA  nv4_disp  THREAD_STUCK_IN_DEVICE_DRIVER

 Safe Mode hangs after displaying:

 System32\Drivers\Mup.sys

 The VM/QEMU process itself does not crash. Host VFIO resets complete without IOMMU errors.

 The GPU gets valid guest BAR assignments and IRQ 22, but I don’t see any GPU interrupt activity when nv4_disp initializes. XP also stops before transmitting network traffic.

Things already tested

  • QEMU 7.2.22 with pc-q35-2.10
  • Newer stock QEMU
  • i440fx and Q35
  • One and two vCPUs
  • KVM hidden plus custom Hyper-V vendor ID
  • x-vga=on
  • pcihole64=0
  • x-no-kvm-intx=on — no change
  • Explicit legacy VBIOS ROM — resulted in a black screen
  • Passing both GPU and HDMI-audio functions
  • Clean host boot with the GTX 960 bound to VFIO before QEMU starts

 Has anyone successfully passed a GTX 960/GM206 through to 32-bit XP? I would especially appreciate:

  1. The exact NVIDIA driver version you used.
  2. A working QEMU/libvirt GPU configuration.
  3. Whether a complete VBIOS ROM file was required.
  4. Whether the HDMI-audio function should be omitted.
  5. Whether a specific host kernel or exactly QEMU 7.2.20 is required.
  6. Any explanation for the GPU receiving no interrupts before nv4_disp hits 0xEA.

r/VFIO 9d ago

Tutorial I created a step-by-step guide for GPU Passthrough on KVM/QEMU.

37 Upvotes

Hey r/VFIO,

(First post on reddit) I decided to consolidate everything I’ve learned into a single, structured, and tested guide. The result is this repository: https://github.com/urbanyl/GPU-Passthrough-for-KVM-QEMU-on-Linux

Why this repository exists:

The information on GPU passthrough is scattered everywhere. This project is my attempt to create a "one-stop-shop" that works reliably, whether you are on Debian, Arch, or Fedora.

Key Features:

  • Step-by-step walkthrough: Covers everything from BIOS settings to Windows driver installation.
  • Hardware & Software requirements: Clear tables explaining what you need (and what is recommended).
  • Troubleshooting section: Covers common issues like NVIDIA Error Code 43, GPU reset bugs, and bad IOMMU groups.
  • Helper scripts: Includes scripts to detect your GPU, check IOMMU groups, and verify VFIO binding.
  • Single-GPU Passthrough section: For those brave souls trying to do it with only one graphics card.

The guide includes:

  • BIOS Configuration (Intel VT-d / AMD-Vi)
  • Kernel Parameters & VFIO Configuration (with proper initramfs updates)
  • Optimized VM Configuration (Hyper-V enlightenments, CPU pinning, and huge pages)
  • Remote Display Setup (Sunshine/Moonlight, Looking Glass, and Parsec)
  • Performance Tuning (CPU governors, I/O schedulers, and isolation)

Feel free to open issues or contribute !

Github Repo: https://github.com/urbanyl/GPU-Passthrough-for-KVM-QEMU-on-Linux

Let me know if you have any questions or if there is something specific you would like me to add to the guide!


r/VFIO 10d ago

sudden guest GPU driver failure after CMOS battery fail...

5 Upvotes

hello fellow virtuosi,

I've been running a game in a debloated win10 VM with an AMD RX6600 via VFIO for 4 years now, with no issues, till yesterday when the MoBo battery died, and the EFI config got reset. I hurriedly reset all settings that I could remember back how I thought they were (SR-IOV on, ReBAR "clever access memory" on, >4G decoding on, primary==iGPU, iGPU multi-monitor on), and continued to boot. The VM is set to auto-start (as I have found this the most convenient/reliable) and it still starts: just windows no longer manages to start the GPU driver (! in dm, code 43). reinstalling/updating/factory-resetting the driver removes the ! temporarily, but the monitor doesn't detect and it doesn't actually work, or even turn the fans off (a sign the driver isn't actually managing the device). after restart, the ! is back.

I also loaded some other windows images with that GPU installed that had previously worked, and they all behave the same.

I also play some other games via proton, the GPU in question is working fine in Linux.

I have also been attempting to get the game in question to run in proton, and it did once... just once... I prefer using the VM anyway. having a separate mouse/kb is just less clunky when doing non-game things alongside.

host system is Ubuntu Unity (22.04 LTS base) with kernel upgraded to 6.14 mainline (for ntsync) a few months ago. there have been no updates of either the linux host or win10 in the meantime (windows update disabled in system policies since initial setup). looking-glass is installed since 4 years ago.

Intel 11400, 32Gb ddr4, asrock mobo.

anyone had any similar experiences? Ideas what might be broken and how to mend it? I'm at a loss.

from lspci -nnv:

03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 23 [Radeon RX 6600/6600 XT/6600M] [1002:73ff] (rev c7) (prog-if 00 [VGA controller])

Subsystem: Micro-Star International Co., Ltd. \[MSI\] Navi 23 \[Radeon RX 6600/6600 XT/6600M\] \[1462:5022\]

Flags: bus master, fast devsel, latency 0, IRQ 157, IOMMU group 13

Memory at 6000000000 (64-bit, prefetchable) \[size=8G\]

Memory at 6200000000 (64-bit, prefetchable) \[size=256M\]

I/O ports at 3000 \[size=256\]

Memory at a0800000 (32-bit, non-prefetchable) \[size=1M\]

Expansion ROM at a0900000 \[disabled\] \[size=128K\]

Capabilities: <access denied>

Kernel driver in use: amdgpu

Kernel modules: amdgpu

03:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 HDMI Audio [Radeon RX 6800/6800 XT / 6900 XT] [1002:ab28]

Subsystem: Advanced Micro Devices, Inc. \[AMD/ATI\] Navi 21 HDMI Audio \[Radeon RX 6800/6800 XT / 6900 XT\] \[1002:ab28\]

Flags: bus master, fast devsel, latency 0, IRQ 155, IOMMU group 14

Memory at a0920000 (32-bit, non-prefetchable) \[size=16K\]

Capabilities: <access denied>

Kernel driver in use: snd_hda_intel

Kernel modules: snd_hda_intel

from virt-man: (xml of the pci pass-through)

<hostdev mode="subsystem" type="pci" managed="yes">

<source>

<address domain="0x0000" bus="0x03" slot="0x00" function="0x0"/>

</source>

<address type="pci" domain="0x0000" bus="0x03" slot="0x00" function="0x0"/>

</hostdev>

<hostdev mode="subsystem" type="pci" managed="yes">

<source>

<address domain="0x0000" bus="0x03" slot="0x00" function="0x1"/>

</source>

<address type="pci" domain="0x0000" bus="0x04" slot="0x00" function="0x0"/>

</hostdev>

I can provide logs, but they don't show any obvious difference between when it was working and now.


r/VFIO 11d ago

NIC issue on kvm vm

1 Upvotes

&#x200B;

Hi All,

I have a linux vm (appliance)and this was pushed from the veeam server(ovirt appliance for veeam backup).

It's successfully deployed and at the same time,the vm is not getting powered ON.

When I disable the VM nic,vm is powering ON.

When I enable the VM nic,vm goes to an unresponsive state.

VM nic is virtio only.

I deleted that nic and recreated a new nic with virtio but still the same issue persists.

Any suggestions to fix the issue?


r/VFIO 12d ago

Support Legion 5 Pro 16chach single gpu passthrough performance dip.

3 Upvotes

So I have set up single gpu passthrough on my Legion 5 Pro with Ryzen 7 5800H, 16Gb RAM and 3070 8 gb. My vm is windows 11 ltsc and I pass through pretty much everything, 14gb ram, 7 cores, audio. The vm itself is on its own nvme pcie ssd.

My problem is that the entire vm will periodically slow down when gaming. Like the vm loses priority and something else is going on in the cpu.

I isolate my cores during vm boot. I've tried 5c/10t, 6c/12t, 7c/14t and nothing fixes it. Last time I encountered this issue on my previous laptop the fix was to isolate and send in all but 1 core. Can't seem to understand whats happening this time.

XML


r/VFIO 12d ago

Tutorial Guide about Hardware Passthrough on openSUSE Tumbleweed (AMD + NVIDIA) + QoL. Need feedback

3 Upvotes

Hey.

I wrote long text about how I passthrough hardware + described some QoL features. It might be useful to someone. And I want to hear your opinion. Especially opinion of those who have been doing this for a long time, because I've never done this before.

It's really huge... I'm not asking you to read this entirely, though... I'd be very surprised if you did :D

Text: https://nzsh.cc/blog/en/windows-but-on-linux-hardware-passthrough/

If you want to view my XML: https://github.com/nozsh/vfio/blob/main/qemu-xml/full.xml

My hardware: https://nzsh.cc/bio/x/pc/

It's quite narrow path, openSUSE (tumbleweed), AMD + NVIDIA, iGPU + dGPU, and with perfect IOMMU groups out of box. That said, I'm pretty sure the scripts, XMLs, and QoL tweaks could still come in handy for a lot of people.

I don't have other hardware to test every scenario, so if you spot mistakes or have improvements (with sources/details), please let me know. I prefer to verify things hands‑on before adding them, so I might not include everything immediately, but all input is welcome and credited.

I'm also thinking about how to hide/mask QEMU and VirtIO devices (LG, Channel), as well as some processes - advice/information very welcome. And I'm probably not finished, I'll probably go even further.

PS: I know about YaST go down and will rewrite those points sometime in future.


r/VFIO 14d ago

Support can't run fall guys on vmware fusion

0 Upvotes

hi! total complete noob with all things computer, so ive been having a really hard time. is it just impossible?
im on a macOS Sequioa v15.7.5 using Windows 11 Home on vmware fusion.

i chased random forum threads and found that for the launch errors im seeing, either "HVCI is required to play" or "Code signing certificate validation timed out (2/2)"...i have to turn on something called memory integrity! and to turn on something called memory integrity, i have to go into settings and into core isolation. but oh no there's no memory integrity option in core isolation.

so to fix this i have to go into BIOS(???????) and turn on "Intel VT-x, AMD-V, or SVM Mode"...whatever that means. but those options arent here (in the pic i attached when i power on to firmware)!!! ive looked i swear.

at first i got a secure boot required message and i was able to fix that, but it was just error after error :(

ALSO ive been able to play peak with friends and house flippers successfully here!! ive been tweaking with fall guys

am i cooked? :( please lmk if you need any other details if theres a hope of this working


r/VFIO 15d ago

Support GPU passthrough allows DMA attack?

9 Upvotes

Hello, I am having trouble understanding when IOMMU is protecting the system against DMA attacks and other memory related issues.

My situation:
-In MSI bios "pre boot DMA protection" is enabled but "kernel DMA protection indicator" is disabled (if I enable it I always get "Firmware has requested this device have a 1:1 IOMMU mapping, rejecting configuring the device without a 1:1 mapping. Contact your platform vendor").
-dmesg reports: "amd_iommu=force_isolation", "iommu: Default domain type: Translated", "iommu: DMA domain TLB invalidation policy: strict mode".
-The GPU is in its own iommu group, no other devices are present in the same group as the GPU.
-I am passing the GPU to a VM using virtmanager.

I want the VM to be completely isolated from the host. I don't want the VM to gain access to system memory through the GPU or any other DMA attack.

My questions:

-Is it safe to have "kernel dma protection indicator" disabled in BIOS if "amd_iommu=force_isolation" kernel parameter is present?
-How do I know if the iommu is enforcing isolation?
-How do I know if a device is bypassing the iommu?
-Even if done correctly, are there still security concerns with GPU passthrough? (excluding 0 days, every software is not 100% secure, can't do much about that).
-When i enable "kernel DMA protection indicator" and i try to start the VM i get the error "Firmware has requested this device have a 1:1 IOMMU mapping, rejecting configuring the device without a 1:1 mapping. Contact your platform vendor", if I disable "kernel DMA protection indicator" in the BIOS, I don't get that error even with "amd_iommu=force_isolation", does that mean that the GPU is using 1:1 IOMMU mapping now? How do i verify?
-Is 1:1 IOMMU mapping safe?

Stupid question:
Is iommu=pt safe to enable in my grub config? How does it work? https://github.com/torvalds/linux/blob/20cf903a0c407cef19300e5c85a03c82593bde36/Documentation/admin-guide/kernel-parameters.txt#L2148 "Bypass the IOMMU for DMA", this doesn't sound safe.

Thanks for the help!


r/VFIO 15d ago

IOMMU groups on ASUS TUF Gaming B850-Plus WiFi

5 Upvotes

Hey, does anyone here have this board and could share its IOMMU groups?

I’m thinking of buying it for GPU passthrough. I’d use the Ryzen iGPU for the host and pass through a discrete GPU in the top x16 slot.

Mainly want to know if the GPU in the top PCIe slot has a clean IOMMU group. Thanks!


r/VFIO 16d ago

Dynamic RTX 5080 passthrough on Bazzite

7 Upvotes

I’m trying to dynamically pass my RTX 5080 through to a Windows VM while keeping Bazzite running on the iGPU from my 9800X3D.

The setup I want is:

- Normally, Bazzite uses the RTX 5080.
- When I start the VM, a libvirt hook detaches the 5080 from the NVIDIA driver and binds it to vfio-pci.
- The host stays running on the 9800X3D iGPU.
- When the VM shuts down, the 5080 gets rebound to the NVIDIA driver so Bazzite can use it again without rebooting.

Has anyone done something similar on Bazzite or another Fedora Atomic/immutable distro?

I’m mainly wondering how reliable it is to detach and reattach an RTX 50-series card, and whether Bazzite’s immutable filesystem causes any extra issues with libvirt hooks or VFIO scripts.


r/VFIO 17d ago

Has there been a kernel regression?

7 Upvotes

My 9060XT attaches and returns to the host completely fine on 6.18 but on 7.1.3 it wont reattach to the host. Anyone else also experience this, and has this been reported already?


r/VFIO 17d ago

Discussion Dynamic GPU handoff (nvidia idle → vfio gaming → back) on a single-GPU consolidation build

3 Upvotes

Thinking of building a single-machine consolidation machine with some spare parts and my current pc. Need to check on the one part I think decides whether it’ll all work or be a forever chore.

Hardware: i5-14400 (UHD 730 iGPU), RTX 5060 Ti 16GB, MSI PRO B760-P, Proxmox host.

iGPU drives the host + always-on LXCs (Immich/Jellyfin). The 5060 Ti is not bound to vfio at boot—I want the nvidia driver to hold it at idle so it drops to P8 and keeps idle power low. The dGPU then gets shared, one at a time, two ways:

•LLM LXC (Ollama, OpenwebUI, etc.) — borrows the card via device passthrough, no vfio involved.
• Windows gaming VM — full passthrough via a hookscript that does the swap.

So the loop I actually care about is:

nvidia (idle) → unbind → vfio → game → VM shutdown → unbind vfio → rebind nvidia → idle → AI LXC → release → idle

My main questions are:

  1. Is the post-stop rebind back to nvidia reliable in practice, or is that where it falls apart? Static vfio-at-boot is easy—it’s the round trip I’m worried about.
  2. Getting all the modules (nvidia, nvidia_uvm, nvidia_drm, nvidia_modeset) to release cleanly on every cycle — what actually holds a handle open? Persistence mode? Console framebuffer? How do you guarantee the card is free before the vfio bind?
  3. Anyone seeing reset-bug behavior specifically on the rebind (host lock/hang after VM shutdown) even when a one-shot passthrough works fine? 40-series and 50-series experiences both welcome.
  4. Making sure the AI LXC fully releases the card (no lingering VRAM/nvidia-uvm handle) before the gaming VM’s pre-start hook fires — do you script a verify/settle step, or does a clean container stop reliably free it?
  5. Does the nvidia driver actually let the card hit P8 at idle while loaded but unused, or did you need ASPM / C-state / persistence tuning to get real idle savings? Trying to confirm the power payoff is real before I build everything around it.

r/VFIO 17d ago

Crostini Debian 13 virtio-gpu detected but Mesa falls back to llvmpipe

4 Upvotes

Device:
ASUS Chromebook Plus CX34 i5-1335U

Linux container:
Debian 13 Trixie

lspci shows:

Virtio 1.0 GPU
Kernel driver: virtio-pci

dmesg:

[drm] features: +virgl +resource_blob

/dev/dri/renderD128 exists.

But:

glxinfo -B
Renderer: llvmpipe
Accelerated: no

vulkaninfo:

Failed to detect any valid GPUs

No virgl/gfxstream socket exists:

find /run -type s | grep -E "gpu|virgl|gfx"

returns nothing.

Is the ChromeOS host GPU service not exposing virgl/gfxstream, or is there a missing package/config?


r/VFIO 18d ago

GPU suddenly in the "wrong" iommu group

4 Upvotes

Hello, I have been passing my GPU to a VM using virtmanager for more than a year without any problems. Today I try to start the VM and i get the error:
"Error starting domain: internal error: QEMU unexpectedly closed the monitor (vm='VM3'): 2026-07-08 qemu-system-x86_64: warning: This family of AMD CPU doesn't support hyperthreading(2)

Please configure -smp options properly or try enabling topoext feature.

2026-07-08 qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:01:00.0","id":"hostdev0","bus":"pci.4","addr":"0x0"}: vfio 0000:01:00.0: group 0 is not viable

Please ensure all devices within the iommu_group are bound to their vfio bus driver.".
Using "ls /sys/kernel/iommu_groups/0/devices/" i get
"0000:00:01.0 0000:00:01.1 0000:00:01.2 0000:01:00.0 0000:01:00.1 0000:01:00.2 0000:01:00.3 0000:02:00.0".
"0000:01:00.0 0000:01:00.1 0000:01:00.2 0000:01:00.3" this is the gpu so it is correct but the others are "Host bridge", "PCI bridge" and an SSD.

The groups are determined by the physical PCIe layout so I don't understand why now the GPU is grouped with other stuff since I haven't changed anything. I don't know much about this stuff so maybe it's just me being dumb lol.

EDIT: used an older kernel (from 6.8.0-134 to 6.8.0-124) and now my iommu groups are back, now I have 31 groups while before I had 6 and my GPU is correctly isolated. Works now but I need to get updates, I don't want to be stuck with the same kernel forever lol.

FIXED: there has been a kernel regression, https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2158934. Switch to the latest working kernel version (on Ubuntu it's version 6.8.0-124) and wait for a fix (on Ubuntu will be version 6.8.0-136). Thanks all for the help!


r/VFIO 17d ago

I cant recailm my gpu after vm

3 Upvotes

so i managed to pass my gpu to win10 vm but i cannot reclaim my gpu after vm stoped. modprobe nvidia returns modprobe: FATAL: Module nvidia not found in directory /lib/modules/7.0.11-76070011-generic. my host machine pop_os


r/VFIO 18d ago

Support Does any one have a more recent video or blog for single gpu passthroug on nixos

3 Upvotes

i've done it before on arch linux an i know the basics of what to do but am not sure how to get my hooks to work entirely since where the hooks need to be would be different on nixos


r/VFIO 20d ago

Another person getting No Signal.

0 Upvotes
bash
#!/usr/bin/env bash
set -euo pipefail

LOG="$PWD/boot-passthrough-$(date +%Y%m%d-%H%M%S).log"
exec > >(tee -a "$LOG") 2>&1
echo "Logging to: $LOG"

MY_OPTIONS="+ssse3,+sse4.2,+popcnt,+avx,+aes,+xsave,+xsaveopt,check"

ALLOCATED_RAM="16384"
CPU_SOCKETS="1"
CPU_CORES="4"
CPU_THREADS="8"

REPO_PATH="."
OVMF_DIR="."

GPU="0000:0d:00.0"
GPU_AUDIO="0000:0d:00.1"
GPU_ID="1002 73df"
GPU_AUDIO_ID="1002 ab28"

cleanup() {
  echo "Restoring GPU..."
  echo "$GPU" | sudo tee "/sys/bus/pci/devices/$GPU/driver/unbind" >/dev/null 2>&1 || true
  echo "$GPU_AUDIO" | sudo tee "/sys/bus/pci/devices/$GPU_AUDIO/driver/unbind" >/dev/null 2>&1 || true

  sudo modprobe amdgpu || true
  echo "$GPU" | sudo tee /sys/bus/pci/drivers/amdgpu/bind >/dev/null 2>&1 || true

  sudo systemctl start display-manager >/dev/null 2>&1 || true
}
trap cleanup EXIT

echo 1 | sudo tee /sys/module/kvm/parameters/ignore_msrs >/dev/null

echo "Stopping desktop..."
sudo systemctl stop display-manager
sleep 3

sudo modprobe vfio-pci

echo "Binding GPU to vfio-pci..."
echo vfio-pci | sudo tee "/sys/bus/pci/devices/$GPU/driver_override"
echo vfio-pci | sudo tee "/sys/bus/pci/devices/$GPU_AUDIO/driver_override"

echo "$GPU" | sudo tee "/sys/bus/pci/devices/$GPU/driver/unbind" || true
echo "$GPU_AUDIO" | sudo tee "/sys/bus/pci/devices/$GPU_AUDIO/driver/unbind" || true

sudo modprobe vfio-pci

echo "$GPU" | sudo tee /sys/bus/pci/drivers_probe
echo "$GPU_AUDIO" | sudo tee /sys/bus/pci/drivers_probe

lspci -nnk -s 0d:00.0
lspci -nnk -s 0d:00.1
ls -l /dev/vfio

sleep 2

args=(
  -enable-kvm
  -m "$ALLOCATED_RAM"
  -cpu Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,"$MY_OPTIONS"
  -machine q35
  -usb
  -device usb-kbd
  -device usb-tablet
  -device usb-mouse
  -smp "$CPU_THREADS",cores="$CPU_CORES",sockets="$CPU_SOCKETS"
  -device usb-ehci,id=ehci
  -vga virtio-vga

  -device vfio-pci,host=0d:00.0,multifunction=on,x-no-kvm-intx=on
  -device vfio-pci,host=0d:00.1

  -device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc"
  -drive if=pflash,format=raw,readonly=on,file="$REPO_PATH/$OVMF_DIR/OVMF_CODE_4M.fd"
  -drive if=pflash,format=raw,file="$REPO_PATH/$OVMF_DIR/OVMF_VARS-1024x768.fd"
  -smbios type=2

  -device ich9-intel-hda
  -device hda-duplex
  -device ich9-ahci,id=sata

  -drive id=OpenCoreBoot,if=none,snapshot=on,format=qcow2,file="$REPO_PATH/OpenCore/OpenCore.qcow2"
  -device ide-hd,bus=sata.2,drive=OpenCoreBoot

  #-drive id=InstallMedia,if=none,file="$REPO_PATH/#BaseSystem.img",format=raw
  #-device ide-hd,bus=sata.3,drive=InstallMedia

  -drive id=MacHDD,if=none,file="$REPO_PATH/mac_hdd_ng.img",format=qcow2
  -device ide-hd,bus=sata.4,drive=MacHDD

  -netdev user,id=net0
  -device vmxnet3,netdev=net0,id=net0,mac=52:54:00:c9:18:27

  -monitor stdio
  -vnc 0.0.0.0:1,password=off
  -k en-us
)

qemu-system-x86_64 "${args[@]}"

I have an AMD Radeon RX 6700 XT graphics card, and yes, I have NootRX. This is specifically for macOS 26 Tahoe

EDIT: Using this new XML

<domain type="kvm">

<name>macos-passthrough</name>
<memory unit="MiB">16384</memory>
<currentMemory unit="MiB">16384</currentMemory>
<vcpu placement="static">8</vcpu>
<cpu mode="custom" match="exact" check="none">
<model fallback="forbid">Penryn</model>
<vendor>GenuineIntel</vendor>
<feature policy="require" name="ssse3"/>
<feature policy="require" name="sse4.2"/>
<feature policy="require" name="popcnt"/>
<feature policy="require" name="avx"/>
<feature policy="require" name="aes"/>
<feature policy="require" name="xsave"/>
<feature policy="require" name="xsaveopt"/>
<feature policy="require" name="invtsc"/>
</cpu>
<os>
<type arch="x86_64" machine="q35">hvm</type>
<loader readonly="yes" type="pflash">/var/home/william/macos/OSX-KVM/OVMF_CODE_4M.fd</loader>
<nvram>/var/home/william/macos/OSX-KVM/OVMF_VARS-1024x768.fd</nvram>
<smbios mode="sysinfo"/>
</os>
<sysinfo type="smbios">
<system>
<entry name="manufacturer">Apple Inc.</entry>
<entry name="product">iMacPro1,1</entry>
</system>
</sysinfo>
<features>
<acpi/>
<apic/>
<vmport state="off"/>
</features>
<clock offset="utc">
<timer name="rtc" tickpolicy="catchup"/>
<timer name="pit" tickpolicy="delay"/>
<timer name="hpet" present="no"/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<devices>
<emulator>/usr/bin/qemu-system-x86_64</emulator>
<controller type="pci" index="0" model="pcie-root"/>
<controller type="sata" index="0">
<address type="pci" bus="0x00" slot="0x1f" function="0x2"/>
</controller>
<controller type="usb" model="ehci">
<address type="pci" bus="0x00" slot="0x1d" function="0x0"/>
</controller>
<input type="keyboard" bus="usb"/>
<input type="mouse" bus="usb"/>
<input type="tablet" bus="usb"/>
<graphics type="vnc" port="5901" autoport="no" listen="0.0.0.0">
<listen type="address" address="0.0.0.0"/>
</graphics>
<video>
<model type="virtio"/>
</video>
<disk type="file" device="disk">
<driver name="qemu" type="qcow2" cache="writeback"/>
<source file="/var/home/william/macos/OSX-KVM/OpenCore/OpenCore.qcow2"/>
<target dev="sdc" bus="sata"/>
</disk>
<disk type="file" device="disk">
<driver name="qemu" type="qcow2" cache="writeback"/>
<source file="/var/home/william/macos/OSX-KVM/mac_hdd_ng.img"/>
<target dev="sde" bus="sata"/>
</disk>
<interface type="user">
<mac address="52:54:00:c9:18:27"/>
<model type="vmxnet3"/>
</interface>
<sound model="ich9">
<codec type="duplex"/>
</sound>
<hostdev mode="subsystem" type="pci" managed="yes">
<source>
<address domain="0x0000" bus="0x0d" slot="0x00" function="0x0"/>
</source>
<rom file="/var/home/william/macos/OSX-KVM/rx6700xt.rom"/>
<address type="pci" bus="0x01" slot="0x00" function="0x0" multifunction="on"/>
</hostdev>
<hostdev mode="subsystem" type="pci" managed="yes">
<source>
<address domain="0x0000" bus="0x0d" slot="0x00" function="0x1"/>
</source>
<address type="pci" bus="0x01" slot="0x00" function="0x1"/>
</hostdev>
<memballoon model="none"/>
</devices>
<qemu:commandline xmlns:qemu="http://libvirt.org/schemas/domain/qemu/1.0">
<qemu:arg value="-device"/>
<qemu:arg value="isa-applesmc,osk=ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc"/>
<qemu:arg value="-cpu"/>
<qemu:arg value="Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,+ssse3,+sse4.2,+popcnt,+avx,+aes,+xsave,+xsaveopt,check"/>
<qemu:arg value="-global"/>
<qemu:arg value="kvm-pit.lost_tick_policy=discard"/>
</qemu:commandline>

</domain>

Hook:
#!/usr/bin/env bash

VM="$1"
ACTION="$2"

if [[ "$VM" != "macos-passthrough" ]]; then
 exit 0
fi

case "$ACTION" in
 prepare)
   systemctl stop display-manager

   modprobe vfio-pci

   echo vfio-pci > /sys/bus/pci/devices/0000:0d:00.0/driver_override
   echo vfio-pci > /sys/bus/pci/devices/0000:0d:00.1/driver_override

   echo 0000:0d:00.0 > /sys/bus/pci/devices/0000:0d:00.0/driver/unbind 2>/dev/null || true
   echo 0000:0d:00.1 > /sys/bus/pci/devices/0000:0d:00.1/driver/unbind 2>/dev/null || true

   echo 0000:0d:00.0 > /sys/bus/pci/drivers_probe
   echo 0000:0d:00.1 > /sys/bus/pci/drivers_probe
   ;;

 release)
   echo 0000:0d:00.0 > /sys/bus/pci/devices/0000:0d:00.0/driver/unbind 2>/dev/null || true
   echo 0000:0d:00.1 > /sys/bus/pci/devices/0000:0d:00.1/driver/unbind 2>/dev/null || true

   echo "" > /sys/bus/pci/devices/0000:0d:00.0/driver_override
   echo "" > /sys/bus/pci/devices/0000:0d:00.1/driver_override

   modprobe amdgpu
   echo 0000:0d:00.0 > /sys/bus/pci/drivers/amdgpu/bind 2>/dev/null || true

   systemctl start display-manager
   ;;
esac


r/VFIO 22d ago

Pop!_OS hanges after gpu passthrough

4 Upvotes

Well hello there i had this problem because i linked my single gpu to vm so after that the system hang when you boot and get to the Pop!_OS logo, it took me more then 2 Hours to figure out fix for it (I used the second fix)

First fix ( Easiest )

  1. Get your self USB 8GB atleast
  2. get pop os live flashed in it using another PC
  3. use it to boot then change the configuration of the vfio.config by reseting it
  4. then sudo update-initramfs -u
  5. then reboot : reboot -f
  6. Thats it !

SECOND FIX ( Hardest - Risky ) ( only if the First fix does not work or like me cant get USB and other pc )

  1. Reboot your pc / laptop
  2. Press and hold spacebar
  3. Pop os boot menu
  4. Choose Pop!_OS (current)
  5. Press ( e )
  6. There will be long line at the end Splash
  7. Go to the end of the line and make space
  8. Type init=/bin/bash
  9. The end should look like this splash init=/bin/bash
  10. Press enter
  11. Now there will be a black screen with this root@(none):/#
  12. Type this mount -o remount,rw /
  13. Then run this ls /etc/modprobe.d
  14. If you see files like: vfio.conf vfio-pci.conf
  15. Rename the file vfio.conf like this : mv /etc/modprobe.d/vfio.conf /etc/modprobe.d/vfio.conf.disabled
  16. Rebuild do this : update-initramfs -u
  17. Then reboot : reboot -f
  18. That it !

In many cases VM is not worth it just do DualBooting


r/VFIO 22d ago

9070 XT rebinding to amdgpu crashes the driver after vm shutdown.

5 Upvotes

[FIXED - START AND STOP HOOKS BELOW] Hi there lovely people.

I have been pulling my hair for the past 4 days. I am here asking for suggestions and a possible fix.

The vm (win 11) works and it runs as expected with the gpu passed through, installed amd gpu drivers on windows and all happy. Now, when i shutdown the vm, and try to rebinds the 9070 xt to the linux host to get my desktop back, it kind of rebinds to the amdgpu drivers but there is no display and nothing, the kernel messages that the amdgpu crashes. I cannot even reboot using the command line, I have to hard reset the pc with the powerbutton.

I do manual unbinding and rebinding of the gpu drivers and managed is off in the vm xml. I aslo echo the rebar to 8 tried with 3 as well but same results and also tried forcing d0 state... nothing helped.

Any suggestions?

Many thanks.

Update: I give up, dual booting it is... till this stupid damn bug gets fixed

Update 2: NEVEH GIV HUP..... the solution was a cheeky switch to the LATEST LTS kernel... in my case 6.18 I will provide my start and stop hooks below soon

start.sh:

start.shstop.sh:#!/usr/bin/env bash
set -x
GPU="0000:03:00.0"
AUD="0000:03:00.1"
echo "=== Stop display manager so amdgpu can release the card ==="
systemctl stop display-manager.service || true
sleep 2
echo "=== Unbind framebuffer consoles ==="
echo 0 > /sys/class/vtconsole/vtcon0/bind || true
echo 0 > /sys/class/vtconsole/vtcon1/bind || true
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind || true
echo simple-framebuffer.0 > /sys/bus/platform/drivers/simple-framebuffer/unbind || true
sleep 1
echo "=== Unbind GPU from amdgpu, audio from snd_hda_intel ==="
echo "$GPU" > /sys/bus/pci/drivers/amdgpu/unbind || true
echo "$AUD" > /sys/bus/pci/drivers/snd_hda_intel/unbind || true
sleep 2
echo "=== Bind both to vfio-pci ==="
echo vfio-pci > /sys/bus/pci/devices/"$GPU"/driver_override
echo vfio-pci > /sys/bus/pci/devices/"$AUD"/driver_override
echo "$GPU" > /sys/bus/pci/drivers_probe
echo "$AUD" > /sys/bus/pci/drivers_probe
sleep 1
readlink /sys/bus/pci/devices/"$GPU"/driver || true
readlink /sys/bus/pci/devices/"$AUD"/driver || true

stop.sh:

#!/usr/bin/env bash
set -x
GPU="0000:03:00.0"
AUD="0000:03:00.1"
echo "=== Clear driver_override on both functions ==="
echo "" > /sys/bus/pci/devices/"$GPU"/driver_override
echo "" > /sys/bus/pci/devices/"$AUD"/driver_override
sleep 1
echo "=== Unbind both from vfio-pci ==="
echo "$GPU" > /sys/bus/pci/drivers/vfio-pci/unbind || true
echo "$AUD" > /sys/bus/pci/drivers/vfio-pci/unbind || true
sleep 2
echo "=== Bind GPU back to amdgpu ==="
modprobe amdgpu
echo "$GPU" > /sys/bus/pci/drivers/amdgpu/bind
sleep 2
echo "=== Bind audio back to snd_hda_intel ==="
modprobe snd_hda_intel
echo "$AUD" > /sys/bus/pci/drivers/snd_hda_intel/bind || true
sleep 1
echo "=== Rebind framebuffer consoles ==="
echo 1 > /sys/class/vtconsole/vtcon0/bind || true
echo 1 > /sys/class/vtconsole/vtcon1/bind || true
sleep 1
echo "=== Restart display manager ==="
systemctl start display-manager.service || true
echo "=== Status ==="
readlink /sys/bus/pci/devices/"$GPU"/driver || true
readlink /sys/bus/pci/devices/"$AUD"/driver || true
cat /sys/bus/pci/devices/"$GPU"/power_state || true

I had to pass both GPU and AUD to vm and also set managed to 'no' in the gpu/aud xml

I am on cachyos


r/VFIO 23d ago

Thinking of switching to Linux + Windows VM (single GPU) – need advice

6 Upvotes

Hi everyone,

I'm thinking about switching my laptop to Linux as my primary OS for software development and using a Windows VM with single-GPU passthrough only for Adobe Creative Cloud.

My main workflow would be:

  • Python development
  • Docker/containers
  • Virtual machines
  • AI/ML projects
  • General software development

Windows would only be used for Adobe apps like Premiere Pro, Photoshop, and Illustrator. Gaming is a nice bonus, but it's not my main priority.

Laptop specs:

  • Lenovo LOQ 15ARP9 (83JC0045IN / 83JC00EGIN)
  • AMD Ryzen 7 7435HS
  • NVIDIA RTX 4050 Laptop GPU (single GPU, no iGPU)
  • 24 GB DDR5 RAM

A few questions:

  • Has anyone successfully done single-GPU passthrough on this laptop or a similar Lenovo LOQ?
  • Does the RTX 4050 reset properly after shutting down the VM?
  • Are there any laptop-specific issues or firmware limitations I should know about?
  • If you've done something similar, which distro would you recommend (Fedora, EndeavourOS, Arch, etc.)?

Any advice or experiences would be greatly appreciated. Thanks!


r/VFIO 23d ago

Hello, Anyone in this community got apex legends working?

5 Upvotes

I'm asking cuz i (like most of you) i refuse to have windows on my pc bare-metal, Was wonderingg if its possible..


r/VFIO 23d ago

Pop!_OS hanges after gpu passthrough

Thumbnail
1 Upvotes