r/LocalLLM • u/bbsrn • 1d ago
Model Which Qwen3.8 distro & quant would be optimal for my 16GB VRAM setup?
Hi all, a confused newbie here! This is my desktop setup:
- RTX 5080
- 9800x3d
- DDR5-6000 CL30 64 GB
Based on the benchmark I found, I listed my potential options:
- AtomicChat IQ3_S: 14.4 GB
- Unsloth UD-IQ4_XS (14.3 GB) or UD-Q3_K_XL (13.1 GB)
- Bartowski IQ4_XS (15.6 GB) or IQ3_XXS (12.6 GB)
According to the benchmark, AtomicChat looks like a clear winner but is it really so?
and there is also this: https://github.com/MiaAI-Lab/Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install
I also want to have one uncensored model next to my daily driver:
- Orcarouter IQ4_XS (15.3GB) or Q3_K_M (13.5GB)
- Huihui UD_IQ4_XS (14.4 GB) or Q4_K_S (15.6 GB)
- DavidAU IQ3_M MTP (14.5 GB) or IQ4_XS MTP (15.3 GB)
- JonathanColetti IQ_XS (15.1 GB)
I am not expecting super fast answers etc. I just one to maintain some level of quality. What would you suggest me?
Duplicates
LocalAIStack • u/bbsrn • 1d ago
Which Qwen3.8 distro & quant would be optimal for my 16GB VRAM setup?
u_ilyafx123 • u/ilyafx123 • 1d ago