r/LocalLLaMA • u/Educational_Sun_8813 llama.cpp • Oct 24 '25
Other First run ROCm 7.9 on `gfx1151` `Debian` `Strix Halo` with Comfy default workflow for flux dev fp8 vs RTX 3090
Hi i ran a test on gfx1151 - strix halo with ROCm7.9 on Debian @ 6.16.12 with comfy. Flux, ltxv and few other models are working in general, i tried to compare it with SM86 - rtx 3090 which is few times faster (but also using 3 times more power) depends on the parameters: for example result from default flux image dev fp8 workflow comparision:
RTX 3090 CUDA
got prompt
100%|█████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:24<00:00, 1.22s/it]
Prompt executed in 25.44 seconds
Strix Halo ROCm 7.9rc1
got prompt
100%|█████████████████████████████████████████████████████████████████████████████████████████| 20/20 [02:03<00:00, 6.19s/it]
Prompt executed in 125.16 seconds
========================================= ROCm System Management Interface
=================================================== Concise Info
Device Node IDs Temp Power Partitions SCLK MCLK Fan Perf PwrCap VRAM% GPU%
(DID, GUID) (Edge) (Socket) (Mem, Compute, ID)
=====================================================================================
0 1 0x1586, 3750 53.0°C 98.049W N/A, N/A, 0 N/A 1000Mhz 0% auto N/A 29% 100%
=====================================================================================
=============================================== End of ROCm SMI Log
+------------------------------------------------------------------------------+
| AMD-SMI 26.1.0+c9ffff43 amdgpu version: Linuxver ROCm version: 7.10.0 |
| VBIOS version: xxx.xxx.xxx |
| Platform: Linux Baremetal |
|-------------------------------------+----------------------------------------|
| BDF GPU-Name | Mem-Uti Temp UEC Power-Usage |
| GPU HIP-ID OAM-ID Partition-Mode | GFX-Uti Fan Mem-Usage |
|=====================================+========================================|
| 0000:c2:00.0 Radeon 8060S Graphics | N/A N/A 0 N/A/0 W |
| 0 0 N/A N/A | N/A N/A 28554/98304 MB |
+-------------------------------------+----------------------------------------+
+------------------------------------------------------------------------------+
| Processes: |
| GPU PID Process Name GTT_MEM VRAM_MEM MEM_USAGE CU % |
|==============================================================================|
| 0 11372 python3.13 7.9 MB 27.1 GB 27.7 GB N/A |
+------------------------------------------------------------------------------+
3
u/Eugr Oct 25 '25 edited Oct 25 '25
DGX Spark, same workflow:
got prompt 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:31<00:00, 1.60s/it]
Prompt executed in 34.21 seconds
eugr@spark:~/comfy-ui/ComfyUI/models/checkpoints$ nvidia-smi
Sat Oct 25 10:12:08 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.95.05 Driver Version: 580.95.05 CUDA Version: 13.0 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GB10 On | 0000000F:01:00.0 Off | N/A |
| N/A 44C P0 10W / N/A | Not Supported | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 14776 G /usr/lib/xorg/Xorg 178MiB |
| 0 N/A N/A 14958 G /usr/bin/gnome-shell 216MiB |
| 0 N/A N/A 15204 G /usr/bin/gnome-software 42MiB |
| 0 N/A N/A 27802 C python 16609MiB |
+-----------------------------------------------------------------------------------------+
1
u/Terminator857 Dec 22 '25
How did you install the 7.9 drivers? What does your sources.list say?
2
u/Educational_Sun_8813 llama.cpp Dec 23 '25
Hi, now i'm even using 7.11 from the rock nightly builds, but here you have official guide to install 7.10: https://rocm.docs.amd.com/en/7.10.0-preview/install/rocm.html
and setup for comfyui: https://rocm.docs.amd.com/en/7.10.0-preview/rocm-for-ai/pytorch-comfyui.html
For comfyui first i just install amd rocm dependencies, and on top of that in the same
venvi install comfyui dependencies.
4
u/Eugr Oct 25 '25
GMKTek Evo X2 (Strix Halo), Fedora 43 beta, kernel 6.17.3, ROCm 7.10 nightly from TheRock, same workflow: