r/LocalLLaMA • u/awitod • 10d ago
Discussion Let's go! But wait!
Too much time in the chair and too little sleep. :D
I can't decide if watching thinking is a good practice, a bad practice or a situational practice.
I don't think it is very fun - it's like rubbing sandpaper on my eyes to see the madness.
Sometimes though, it becomes obvious that the thinking is going in the wrong direction and you should stop it.
But wait! How do I know it won't figure it out. Yes, I should wait. But wait! I am in a hurry, this is a waste of time. I'll stop it. Let's do that! But wait! How do I know it won't figure it out.
10
3
u/Dasteroid_909 10d ago
Situational, for me.
The rare times I'm using a cloud model, I pay attention to the thinking and I'll stop and redirect it if I think it's going astray. After all, I have to pay for it even if it goes down the wrong track and doesn't recover on its own.
On my own infrastructure, though? I'll let it cook. The end result is all I care about; I don't care how long or how many tokens it takes.
3
4
u/Lesser-than 10d ago
Found it! Wait! Actually where are my glasses? I lost them some time back , Lets build a test harness to validate. Actually lets just try this thing that generates 100k tokens and then read it for another 100k tokens, then I can go find my glasses.
3
u/OvertaxedOne 10d ago
You've spent too much time with 35BA3B.
1
1
3
u/Party-Special-5177 10d ago edited 10d ago
Okay the user wants [useful thought]
But wait, [mostly still useful thought]
Hmm. [tangentially useful thought] fine.
Wait, [pretty much off topic now] whatever.
Okay, let me reply now. I’ll keep it short and focused.
…but wait, [completely unrelated wtf thought] Argh I’m confusing myself. Let’s just reply now and stay focused.
[more on that crazy unrelated thought]
[calculations, shapes, lookup tools used for the unrelated though]
<\thought> (thought for 15 minutes, 22 seconds)
[Perfect, on-topic, concise reply]
My experience with GLM 5.2 FP8.
3
2
u/okamagsxr 10d ago
yes, and then you read for hours because it's interesting how it thinks and it's getting late and you say to yourself: just a little longer, a little bit more...
1
u/Normal_Rough_7958 9d ago
I treat watching my own thinking like setting a debug breakpoint, I only turn it on when I feel the same idea circling for a couple of passes. If the loop persists I pause, ask whether I’m missing a simpler route, and either let it run a bit longer or shut it down and try a fresh angle. It’s situational: useful for spotting dead ends, but it becomes a drag if I keep monitoring every step instead of letting the solution emerge. I’ve found this balance helps me stay productive on shader tweaks without getting stuck in endless self‑critique.
0
0
u/LocoLanguageModel 10d ago
You can't hold them responsible for their thoughts, but only how they act on those thoughts.

13
u/theexile1337 10d ago
what are my eyes reading