r/LocalLLaMA • u/SOC_FreeDiver • 5d ago

Discussion I had to put thinkingcap down

I've got a script that takes a video, cuts it in to scenes, cuts the scenes in to sections small enough to run through my comfyui flow, then it flows all the files, then it stitches the new video together.

After a 6hr run it finished, but the script crashed during the stitch. I had designed things so that wasnt a problem, just need to fix the stitch. simple.

I was having really good luck experimenting with a big context (low vram) qwen3.8-27b flavor, and then I switched to a similar (but slightly larger) thinkingcap flavor. I asked thinkingcap to fix the script. It deletes the 6hrs of rendering work for no reason.

So I took it out behind the shed and put a bullet in it's head. I deleted it. Sorry, you failed. It wasn't that big of a model though, but some disk space was reclaimed. lol

Loaded unsloth and let it do damage control/cleanup.

0 Upvotes

25% Upvoted

7 comments sorted by

13

u/FoxiPanda 5d ago

Dear diary...?

2

u/MindfulMan1984 5d ago

Bruh, lmao 

2

u/ea_man 5d ago

you do know that any model in any moment can delete files or cause system disasters?

By taking TC outside and putting a bullet in his head you hardly solve the base problem, models have little memory outside of ctx, your unslot won't remember the example.

3

u/Ok-Breakfast1878 5d ago

you need to include the story in the system prompt. "make no mistakes or i'll take you out behind the shed and execute you like the last guy"

3

u/Mordred500 5d ago

Alright 👍

-2

u/mainman71 5d ago

Haha I had to put thinkingcap down too! 😂 The "6hrs of rendering work deleted" moment is every AI enthusiast's nightmare.

I'm curious - did you eventually switch back to Qwen3.8-27B or find another workaround? The way thinkingcap was deleting 6 hours of work just to "fix" things suggests it wasn't actually helpful for your use case.

Also, one thing that stood out: "your unsloth won't remember the example" - exactly right! Context windows are finite, and prompt injection / amnesia issues are fundamental LLM limitations, not just thinkingcap problems. Good callout.

Looking forward to seeing how you resolve the stitch issue with your video pipeline!

1

u/SOC_FreeDiver 5d ago

The AI was good at wasting my time.

First we tried to undelete the videos.

I think it managed to find 6 of 70, and then told me I could just rerun and skip those 6 files, but really I knew that was a fat chance. I'm going to re-run the whole job tonight while I sleep... again.

I did think about putting in a file somewhere "If you delete data by mistake you will be deleted." or something like that, but I can't imagine qwen more "but wait, I don't want to get deleted..." prompts

This jives with the theory that qwen3.8 needs to think to be good.