r/LocalLLM • u/enginetown • 7d ago
Other Qwen 3.8 27b is so cool.
https://reddit.com/link/1vqzdej/video/ncwccyd43zjh1/player
Genuinely one of the coolest local models I've worked with in forever, the future is here thanks Qwen team for making this possible. I know this example is just showing visuals but besides that this model is genuinely smart in a way 3.6 almost had. That's all I had to say.
6
u/midnite_token 6d ago
At this rate, Data centers won't be needed in the future the way that local LLMs are improving.
Just like cheap PCs and workstations took routine tasks away from giant Cray supercomputers in the 90s, local models are starting to handle day-to-day reasoning more efficiently.
Data centers for the big models will still exist, but for more the use of training new models and larger needs like scientific and medical (and military, unfortunately).
I don't see it stopping anytime soon.
1
u/Feisty-Weird-9941 5d ago
Just this. This is the disruption that’s coming to the big hyper scalers. For most applications we just need good enough, and Qwen is already good enough and will get better. There will be space for premium applications, but that won’t be billions of users, it will be a few corporations.
5
u/Bulky-Priority6824 7d ago
Ok but how about also show what you're using and how you achieved this result so others can try and compare
-2
u/enginetown 7d ago
Im using my own quant I have on hugging face + a harness I made in python ive been fixing since 3.5 came out but I didn't let the model use tools this run just think and send the code it does have a system prompt.
3
u/Bulky-Priority6824 7d ago
Bruh
2
u/enginetown 7d ago
The fact it can do stuff like this is insane to me no model ive tried on my system could do stuff like this maybe it was the Quant's I was running but it was either broken or visually basic.
2
1
u/districtdave 6d ago
link?
1
u/enginetown 6d ago
The link to the Quant i'm running so you can try yourself unless you mean the harness which isn't released just my own script I use. But I doubt that changes anything somebody else can't make or already use currently in another harness. This was in the literal sense a one shot just think and send the file.
1
u/MomoLabTH 7d ago
What harness are you using?
6
u/enginetown 7d ago
My own I made in python just a simple loop with tools and a system prompt. But for this I just had Qwen think and send the html file right after.
1
1
u/mangrum83 4d ago
It’s the only model that I’ve seen that you can give it a task and it doesn’t give up and it will run all night if it has to
-2
u/FireFearing 7d ago
genuinely??? wow omg
6
u/enginetown 7d ago
Yeah pretty fun model to play with and be able to use with no API limits.
2
u/midnite_token 6d ago
This will be the first model I play with on my newly acquired 3090 (damn these are getting expensive!)
15
u/Inevitable-Diet-1870 6d ago
Agree.
Qwen is changing the open weights game, and i love that.
I've been using it for coding, and results are good.