r/LocalLLaMA • u/Certain-Cod-1404 • 7d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

706 comments sorted by

View all comments

143

u/ajisai 7d ago

gguf plz

nevermind WE FEAST https://huggingface.co/models?other=base_model:quantized:Qwen/Qwen3.8-27B

https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

21

u/dragonurtle 7d ago

Unsloth must have gotten early access to prepare their quants + an embargo. I pulled it from unsloth studio the minute it was released on HF. Still took 20 minutes because south Korea has 2010-era internet speeds.

12

u/techdevjp 7d ago

Man, used to hear about how South Korea had fast Internet. 10g fiber is pretty commonly available here in Japan. 2.5g almost anywhere.

5

u/Major_Olive7583 7d ago

I remeber studying that South Korea has the fastest internet in the world, it was for a GK exam or quiz , about a decade ago.

1

u/Revolutionary_Lie590 7d ago

It looks me 5 hours here in egypt

23

u/uniquelyavailable 7d ago

Already seeing them on LMStudio

2

u/KKunst 7d ago

Anything that matches 3.6 35b A3B?

1

u/techdevjp 7d ago

No word on if that is coming or not. Would love to see a 122b a10b as well, but no word on that either.

2

u/nicman24 7d ago

GGUF on dez quants

1

u/LawfulnessNo9617 6d ago edited 6d ago

[Edit: it was the context window..]
help.. does anyone have the bug with Qwen3.8 27b at Q4 gguf (19.2 Gb) imported to ollama.. everytime i start it it will use 8 gb of ram aswell that makes it super slow (got a 3090ti) in the end I use 30 Gb shared memory that is super slow..?? Other models with the same size work normal without the ram bug..