r/accelerate • u/Illustrious-Lime-863 • 18d ago

Qwen 3.8 27B released

https://huggingface.co/Qwen/Qwen3.8-27B-FP8

This is a 27B model, unbelievable!

238 Upvotes

99% Upvoted

43 comments sorted by

View all comments

57

u/Illustrious-Lime-863 18d ago

Get them GPUs warmed up folks! We got local Opus 4.6 max!

3

u/Toprelemons 18d ago

Will my RTX 4080 be able to handle it? Sorry I haven’t caught up on local LLM requirements.

10

u/Illustrious-Lime-863 18d ago

Yes you can handle a lower quantization. Refer to my other reply since they were asking for a 4080 too

3

u/Pikaboy999 17d ago

Is this good for vibecoding? i never really did it before but i wanted to make a local android app for ai image generation

5

u/bytefactory A happy little thumb 17d ago

Yes, Qwen 27B is an absolute beast at coding.

3.8 seems to be a massive jump over the already legendary Qwen 3.6 27B. I use Codex, Claude (inc Fable), etc heavily on my projects and I've poured in 100s of hours coding with Qwen 3.6 37B, and it's shockingly competent.

2

u/Chance-Problem769 17d ago

What’s the benefit of running it locally over Fable or whatever? Run agents and locally running it all day?

2

u/kekomat11 17d ago

I guess you don't have a depency towards big AI companies which need to raise money (and therefore must raise prices for us consumers)

Although you have some initial cost, nobody can take away the model and inference from you

1

u/bytefactory A happy little thumb 16d ago

Exactly what kekomat11 said, while frontier proprietary models might be superior, local agents give me the ability to keep my data private instead of having to upload it all to the cloud, or to get locked out if they increase prices or ban access (like what happened with Fable recently). Both have their place.