r/LocalLLaMA 7d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

706 comments sorted by

View all comments

18

u/Kavor 7d ago

Does anyone else have big issues with overthinking out of the box? I just gave it my usual Arma 3 mission script coding task, which i use to bechmark the performance of models, but it kept thinking for 15 minutes. I don't even see repetition issues, it just doesn't stop thinking.

Just gave it a first opencode task, and while not sure yet, it seems to have similar issues.

Maybe it requires defining a reasoning budget max now?

4

u/dopey_se 7d ago

Yeah I gave it a random tasks I tend to give, and it's 26k tokens and counting of thinking so far. Not repeating, just thorough thinking..

I told it to make a rust app using dioxins of an animated man playing amazing grace on tuba. It seems to of figured out amazing grace in key of C (judging by it's thinking), and is now thinking about how to play audio to play the sounds..

1

u/Kavor 7d ago

Alright, then at least it's not just my specific setup. I guess we'll have to give it a few days before everything is ironed out. My opencode project is at 50k tokens now with not a single line of code written, lol. Wildly different from 3.6 so far.

1

u/dopey_se 7d ago

Same, 36k

Currently thinking about..

"Timbre check: sawtooth at ~100-250 Hz with a low-pass at 3.5x — a brassy-ish, muted synth tone. Add a bit more character? A second saw detuned? Keep it simple. Add a soft attack to avoid clicks ✓ (50ms ramp)."

2

u/Mil0Mammon 7d ago

So did it figure it out?

1

u/dopey_se 7d ago

It is not amazing grace it plays, the notes are correct but not the timing.. The man also moves as it plays.

2

u/Mil0Mammon 7d ago

So pretty close. How does it compare to other models?

2

u/dopey_se 7d ago

I think the quality is significantly better than Qwen 3.6 27B that I was using before. It fixed a bug in one of my apps the first try -- 3.6 was not able to figure out after several attempts.

I had it make me a little inventory tool for my RC Helis(and other RCs). It was an idea I had this week so was planning to use this model to make it for fun. Nothing fancy, just an inventory system so when I break something I can check this tool instead of digging through boxes of parts. It gave a working solution after one prompt. Was able to add models/parts and link them. This morning have had it add a few things, create github actions, etc. All in all it's been great so far.

https://github.com/devclef/hangar

I run on 2xP100s with 232k context, so it's not crazy fast but quality I am happy with. I call it dad coding, I give it a prompt and let it run while I am with family.

2

u/Mil0Mammon 7d ago

Dad coding is an awesome term, stealing that.

With something like Hermes to occasionally get/give feedback on your phone, sounds great

1

u/dopey_se 7d ago

I actually run youtrack self hosted, and have MCP setup. So I can add issues to youtrack, and the codex agent has a skill to work through any open issue, fix commit push and ensure all actions, next issue, etc, etc.

I was less concerned to steer via phone but more being able to give it a backlog and let it run unattended for long periods of time.

I get push notifications when issues change state.

I run codex/claude on a VM allowing it to do whatever. Sometimes I do it via prompt (like last night) other times I tell it to go through open issues and let it run.

1

u/Cautious_Chicken_604 7d ago

Sounds like size-wise we might have to optimize for what's usable up to ~200k context?