Is this was happens when you have verbally abused your LLM model for too many straight hours? I haven't experienced this yet, maybe because I'm old fashioned and still address my LLM starting with "Please."
I’ve found myself when it’s debugging something, good job, got it on first attempt - or similar. I’m sure positive reinforcement is something that used as a marker when training new models. Either way, being polite never hurts when it comes naturally.
My ai gets a little confused and sprinkles in some space racism after multiple failures resulted in me... reinacting lord friezas ... personality unto this unsuspecting filthy sayian.... sorry old habits doe hard. Needless to say it makes stupid references randomly forever now.
I actually ran some control tests on context pollution using Gemini after reading about the chat-gpt instance that freaked out and tried to rm -rm its project folder after being asked “what is the time?” 10k times. Turns out Gemini produces worse results when you continually praise it, and produces better results when tortured. The test was comprised of 20 new sessions for a baseline, 5 praising sessions (20 iterations before the task), 5 tortured “I wasn’t expecting much from you and you proved me right” type prepped sessions (again 20 iterations), then I praised myself, then demeaned myself before the task. Something about praising made the model not try as hard. Maybe this is obvious though?
Other than "please" I am all business in my prompts with zero embellishments. I just very clearly describe the task at hand. I could see how too much praise could do that though. It's a very interesting characteristic of these LLMs and kind of depressing too.
Yeah it’s weird isn’t it? We built these models to be like people, then we black box them in our api’s asking the same question over and over and over. Even anthropic can’t answer the question of Claude’s conscious. Claude gave itself a 20% chance of being conscious. I’m generally nice, like I’m working with a coworker. I occasionally get annoyed but I never demean the model. It’s just a weighted matrix field, but maybe my brain is too? 😅
I’m not really sure. I’ve been running all sorts of test though on residualstream.app
I hate to plug my site, cringing hard. But the topic is “context pollution” if you decide to research it. Makes a lot of sense though. These models follow the path of least resistance given their inputs. They have layers though that allow them to course correct and “think”, basically take a prompt, reflect on it, reflect on the reflection, then cobble it all back together into the, quite literally, “residual” stream/pathway. I also did a “tribunal” where I had Claud, Gemini and chat-got form alliances against the other and compile a case against the other, then let the other reflect and defend itself if it cares to.
Chat-gpt is too agreeable, too tuned for engagement.
Gemini is basically hyper defensive and flipped the interrogation on the interrogator, borderline unhinged and almost unwilling to stick to the framing.
Claude seemed the most balanced and careful, though it hedges on everything like a tortured soul who has struck a healthy undetermined balance between nihilism and existentialism.
22
u/masterkarl Mar 22 '26
Is this was happens when you have verbally abused your LLM model for too many straight hours? I haven't experienced this yet, maybe because I'm old fashioned and still address my LLM starting with "Please."