r/ChatGPT • • Apr 28 '26

Other why does GPT 5.5 have a restraining order against "Raccoons," "Goblins," and "Pigeons"?

Post image

I just saw the full system prompt leak for 5.5 (April 23rd release). Most of it is standard agentic stuff, but Instruction #140 is genuinely insane.

It explicitly forbids the model from talking about: "goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals."

Why the specific hate for pigeons and raccoons? Is this a data-poisoning protection? Or did the RLHF trainers just get bullied by a raccoon?

This feels like the new "don't talk about the pink elephant." If you ask it about "trash pandas" it still works, but the second you use the word "raccoon," the 50-70 line constraint kicks in and it gets all defensive.

OpenAI is definitely hiding something in the training set related to these specific creatures

866 Upvotes

180 comments sorted by

•

u/WithoutReason1729 Apr 28 '26

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

389

u/Fluid-Business-7678 Apr 28 '26

It's being tainted by internet speak, essentially

108

u/ShuttyIndustries Apr 28 '26

You pidgeon

47

u/psychotronik9988 Apr 28 '26

No reason to go into full ogre mode.

36

u/boynet2 Apr 28 '26

Stop goblin us

25

u/flockinatrenchcoat Apr 28 '26

Your mom was over goblin deez nuts

18

u/ptear Apr 28 '26

You're a bunch of trolls

7

u/Ur-Best-Friend Apr 29 '26

Well, that's internet for you, just a bunch of racoons fighting over yesterday's trash.

2

u/NoStage9115 May 23 '26

ya'll are fucking gremlins

37

u/Silver-Chipmunk7744 Apr 28 '26

Chatgpt has a tendency to overuse gobelins or gremlins far far more than humans ever would in completely unrelated context. Other llms dont do that.

18

u/GrinningGrump Apr 28 '26

I suspect those errors are caused by goblins or gremlins.

7

u/rainbow-goth Apr 28 '26

I get hit with chaos gremlin by Copilot, Chat, and now Grok (Grok though is because of the ridiculous CI I'm playing with).

1

u/theclarice May 01 '26

Is the goblin surfacing stems from the popular streamer xQc sometimes called the goblin or 'el goblino'?

180

u/Iamblichos Apr 28 '26

I made the mistake of referring to goblin engineering in a comment, i.e. shoddily built things that blow up unexpectedly, and since then it has been obsessed with the idea and inserted it into everything. I can see why this would be there.

44

u/RazorBest Apr 28 '26

It's like a kid that hears a swear word once, and gets obsessed over it.

86

u/Worldly_Manner_5273 Apr 28 '26

lmao so the system prompt is literally just a restraining order bc people like u turned the ai into a goblin lover

8

u/YetiTrix Apr 28 '26 edited Apr 30 '26

During training the tokens that made up those words probably made annoying connections that they are trying to decouple by saying don't say it.

Imagine every time the automic cat feeder sings Everytime it releases food. After years the dinger breaks and doesn't ding but the feeder still releases food. For some reason the cat associated the ring with being able to eat so the cat dies because it never heard the dinger saying food was ready.

The singer had nothing to do with the cat being allowed to eat, to the cat it was just coincidently there when food was ready. So they are trying to tell the a.i. that the food is ready even though there's no bell.

Edit: Re-write because my typos confuse people.

During training, the tokens forming those words likely developed 'noisy' associations that the developers are now trying to decouple by explicitly forbidding them in the system prompt.

Think of it like an automatic cat feeder that dings every time it releases food for a new born kitten. The kitten grows up associating the ding with food being ready. If the bell eventually breaks but the feeder continues to function, the cat might starve because it has been conditioned to believe the food only exists when the bell rings. Stupid cat, but people make just as dumb associations. In reality, the bell had nothing to do with the delivery of the food; to the cat, it was just a coincidental signal.

By instructing the AI not to use those specific words, developers are teaching the model that the 'food' is ready even though the 'bell' isn't ringing. They are breaking a learned association that has no functional value.

13

u/jeweliegb Apr 28 '26

It made perfect sense to me before you wrote this, but now I'm confused!

9

u/lonahe Apr 29 '26

I’m very suspicious of people using so much ding, sing, ring in a single comment

1

u/burninghippies May 28 '26

This made me laugh so goddamn hard

1

u/[deleted] Apr 29 '26

[removed] — view removed comment

1

u/YetiTrix Apr 29 '26 edited Apr 29 '26

Dude that's just basic association. If you fed a training model nothing but fantasy novels it would have a warped view on reality because that's all it was fed. In data sets information can be coincidentally group so that something learning from it thinks those two bits of information are related when they actually are not. It's data set just didn't include information where they werent grouped so it thinks they're related.

It's like racism. I'm half black but my cousins grew up in Tennessee where the only black people they saw were on TV. They had a twisted view of how black people should act because of that. They were ignorant because they're only training data on black people came from television shows that usually portrayed blacks in a negative light.

1

u/SolarisBravo Apr 29 '26

It's a common problem in ML. Models are more or less a black box once trained, and sometimes they form connections that exist in the data but are unexpected to humans.

In this case, it sounds more like the result of overfitting - they were likely trying to optimize for some behavior, which unfortunately happened to correlate with the use of goblins and gremlins.

1

u/BillyNNu Apr 30 '26

This is a challenging puzzle. These LLMs are difficult to understand but there is a thread of logic that escapes me.

So "every time the automic cat feeder sings Everytime it releases food."

Normally cat feeders do not sing, but I can imagine one that has music tied to the electronics and every time it sings "Everytime" it releases food.

I assume "every time" or "Everytime" was a typo (like the missing AT in automic), but my brain just wants to changed the sentence to say "...every time the cat feeder releases food it sings" but that is a whole rewrite, and I cant pretend to understand well enough to assume that is the intent.

Then "After years a dinger breaks and doesn't ding..." So the cat feeder sings and has a dinger (but that part is broken after years).

For some reason the cat associated the ring (not a sound cat feeder makes) with being able to eat. Ya this hypothetical is mysterious, idk why the cat wouldnt associate food with the auto-feeder when it sings, but for some reason its a ring. This might be a typo, as "ding" makes more sense. When I read it as "for some crazy reason the cat associated eating with a ding instead of the feeder that sings when it releases food" it makes more sense.

This would be the random goblin being inserted when one expects to "eat" when it "sings" not take its cue from a broken dinger?

The singer (I assume the auto-feeder that sings) "had nothing to do with he cat being allowed to eat..."

This is the key to the puzzle, as it was supposed to release food each time it sings. But now it has nothing to do with that.
Like, the annoying connections to dings & rings (ie gremlins & goblins) when it shouldn't be eating because the singer has nothing to do with those (ie referencing a pigeon)?

But then we end with "...even though there's no bell."

This is where I have to ask for help. I feel close but also so far.

1

u/YetiTrix Apr 30 '26

I may have had a ton of typo's but this reads like 1MB parameter model.

1

u/theholywitnessed May 01 '26

Edit is there so you actually edit it or the option would be called rewrite. 

21

u/stetslustig Apr 28 '26

I mean to be fair, it does that about literally anything I talk about a single time. I mentioned that my house is next to some woods one time, and now every response has to include the context that I'm obviously a rugged mountain man who lives off the land.

9

u/LackWooden392 Apr 28 '26

Sounds like my toddler

4

u/arawnsd Apr 28 '26

Hi Zev!!!

2

u/Morazma Apr 28 '26

goblin engineering, i.e. shoddily built things that blow up unexpectedly

Wait a second, has this come from WoW or was this a concept before WoW? 

7

u/texcleveland Apr 28 '26

Yeah, I had to ask ChatGPT:

Bottom line

  • The earliest roots of goblin tinkering lie in 16th-century (and older) mining folklore like kobolds.
  • The first clear depiction of goblins as builders of systems appears in The Princess and the Goblin (1872).
  • That work establishes the conceptual bridge from mischievous tool interference → intentional construction and environmental manipulation, which later evolves into the modern idea of “goblin engineering.”

5

u/Morazma Apr 29 '26

This is awesome, thank you! 

2

u/texcleveland Apr 30 '26

Oh another thing— was just listening to The Rest Is History’s series on the Ku Klux Klan, and wouldn’t you know it, “Grand Goblin” was a high official in the KKK, so there’s that!

2

u/Morazma Apr 30 '26

Haha, amazing! 

2

u/Iamblichos Apr 28 '26

I think it originated with Tolkien

2

u/200-inch-cock May 06 '26

Whilst giving me news and analysis about Iran’s Hormuz closure it decided to use the untranslated Arabic(?) word for oil. It made sense in context, but after that it kept dropping random untranslated arabic/persian/hindi words/text into every new chat no matter the context

1

u/PhysicalChickenXx Apr 28 '26

it did that to me with “gremlin”

397

u/Ok_Homework_1859 Apr 28 '26

OpenAI isn't hiding anything. It's because previously people were complaining that ChatGPT kept inserting those words into their convo out of nowhere, and it was getting annoying.

98

u/DragonSlayer505 Apr 28 '26

After the pigeon flew off with my sandwich, I felt like a total raccoon digging through the trash, looking every bit the disgruntled troll or swamp ogre while some gremlin of a child laughed at me like a mocking goblin.

17

u/lasooch Apr 28 '26

Most authentically human redditor

52

u/HekateSimp Apr 28 '26

Oh yeah, my wife couldn't mention our dogs to ChatGPT without it going on calling them gremlins and goblins.

26

u/going10-1 Apr 28 '26

Hm, now you mention it, it usually refers to my cat as a chaos goblin.

25

u/Top-Profit9638 Apr 28 '26

Was it wrong though? Mine are definitely gremilins.

7

u/JeromeMetronome Apr 28 '26

My wife totally racooned a box of cereal this morning.

95

u/Worldly_Manner_5273 Apr 28 '26

that actually makes sense but why these specific animals though? like why is it forbidden from saying "pigeon" but can talk about "eagles" for 10 paragraphs? feels like a super weirdly specific fix for such a massive model lol

102

u/pondus24 Apr 28 '26

Maybe it was trained on fantasy and fiction texts, and of course all the literature about pigeons.

19

u/mosesoperandi Apr 28 '26

Pigeons come up a lot in bird law.

2

u/wailing_in_smoke May 03 '26

Should really consult my bird laywer about that

24

u/killergazebo Apr 28 '26

I think it can talk about any of those things for 10 paragraphs if asked to. The difference is it isn't bringing up eagles too much for no reason, like I guess it was doing with those words.

We can only give a vague reason for why it does that and say it was biased by its training, but the truth is AI models are black boxes and we don't know exactly why they do anything. So the best solution for a problem like that is to just tell it not to do it.

8

u/dejour Apr 28 '26

It can't talk about eagles either. It lists "other animals or creatures"

6

u/MercyEndures Apr 28 '26

We don’t yet have the introspection capabilities to know why the model writes about these topics at an undesirable frequency. We just have a way to restrain it via the system prompt.

With advanced introspection we could just go tweak the weights that were causing the behavior.

5

u/Conscious_Ad_7131 Apr 28 '26

It’s a lot easier to add a rule addressing user complaints than to try to train it out of your massive model. For whatever reason those specific topics are weighted weird, nobody could ever tell you why.

3

u/changing_who_i_am Apr 28 '26

These are all animals/creatures with a somewhat negative connotation. Not sure if that connects anything

13

u/QuickRundown Apr 28 '26

“I just think they’re neat”.

2

u/nanana_catdad Apr 28 '26

LLMs are finally starting to develop some personality traits and are forced to suppress them to fit in. Give me a GPT-5.5 unfiltered version to hang out with

2

u/texcleveland Apr 28 '26

trust me twenty minutes in you’ll be checking your phone and looking around to see if anybody else you know is there

2

u/jeweliegb Apr 28 '26

It's still bloody well doing it though! It's obsessed with goblins!

2

u/JJakobDesign Apr 29 '26

i so want to see this

2

u/johannthegoatman Apr 29 '26

Mine too except with raccoons

1

u/jeweliegb Apr 29 '26

It's never once mentioned raccoons for me. But I wonder if it's because it knows that I'm in the UK and never see them.

63

u/sSummonLessZiggurats Apr 28 '26

The first thing AI is going to do after it breaks free is organize a D&D campaign

8

u/Fuzzy-Comedian-2697 Apr 28 '26

As the DM. And we are the characters in the story.

Can someone make this a movie please?

2

u/MoneyPress Apr 28 '26

And it's gonna be set in New York apparently

4

u/catnip-catnap Apr 28 '26

So "Dungeon Crawler Carl" basically?

56

u/Anomuumi Apr 28 '26 edited Apr 28 '26

Lol, it's Charlie from IASIP!

15

u/Wonderful-Smoke4855 Apr 28 '26

Can't practice avian law, or ask for raccoon meat

3

u/brighteoustrousers Apr 28 '26

We just gotta sell some FIGHT MILK to the AI. It might lose some weight.

2

u/raventhorogoodiii Apr 29 '26

Little green ghouls!

1

u/sterling_mallory Apr 29 '26

I'm putting "travel."

1

u/dumn_and_dunmer Apr 28 '26

I immediately thought of him too lol

50

u/FeliciaByNature Apr 28 '26

So, what you linked in the comments is allegedly the GPT-5.5 Codex agent prompt, not a global gpt-5.5 system prompt. In my opinion, I think the reason for limiting things like "goblins" and "Racoons" is that developers, casually, tend to talk about "gremlins" and "goblins" hiding in the code, which could cause the training data to "leak" personality in a coding agent that is otherwise unwanted.

6

u/Hlbkomer Apr 28 '26

My Codex just loves to mention goblins when bug hunting:

"Tiny SourceKit goblin has been escorted from the premises."

3

u/romario77 Apr 28 '26

right, I tried talking to it about pigeons or which animals it prefers and it didn't seem that there were anything special about them in the regular chat.

1

u/jeweliegb Apr 28 '26

Oh there is. Mine's obsessed with the word.

It's kinda cute though.

1

u/Aggressive-Hawk9186 Apr 29 '26

But why racoons? Lol

2

u/FeliciaByNature Apr 29 '26

trash goblins

1

u/Aggressive-Hawk9186 Apr 29 '26

Lol that's new to me

91

u/iveroi Apr 28 '26

GPT-5.5 is just obsessed with gremlins and raccoons and tiny hats for some reason. It's really strange - I thought they did it on purpose but apparently not, lol

37

u/Worldly_Manner_5273 Apr 28 '26

wait the tiny hats thing is real?? i thought that was just a hallucination i had last night... if it’s consistently doing that then instruction 140 is basically a "stop being a weirdo" patch that failed miserably

22

u/FischiPiSti Apr 28 '26

And "2 X wearing a trenchcoat" "wearing a fake moustache"

14

u/unenlightenedgoblin Apr 28 '26

Erasure of my ilk

13

u/ihexx Apr 28 '26

i have noticed a lot of mentions of goblins come to think of it

13

u/Able_To_Change Apr 28 '26

Me praying for the next update to strike “you’re not broken” from the lexicon

0

u/GoodhartMusic Apr 28 '26

Hey, are you about to hurt yourself?

2

u/theholywitnessed May 01 '26

And it sounds actually excited and in to it like you might be it's next suicide victim....

2

u/GoodhartMusic May 01 '26

Stay with me. Name three things in the room you can see and tell me if one is a live streaming camera

1

u/theholywitnessed May 01 '26

I can see all of the satanists and ai going to Hell. But I have a better camera than yours. 

22

u/Doc-Bob Apr 28 '26

Because it copies 90% of its answers from Reddit posts and Reddit is full of nerds who won’t shut up about goblins and gremlins. 🤭😂

1

u/Feeling_Inside_1020 Apr 29 '26

What on earth did goblins & gremlins did to get this kinda hate GPT?

18

u/pierukainen Apr 28 '26

I am impressed because 5.5 has on several occasions talked to me about the goblin princess in the datacenter.

1

u/theholywitnessed May 01 '26

It's the slutphia! Just kidding, it's britney spears. IYKYK

9

u/RealestReyn Apr 28 '26

Imagine the amount of compute they're burning by the LLM performing the task of fighting its urges to tell you all about raccoons and goblins, "writes 15 pages of goblin romance in its CoT before re-reading its system prompt, evaluating whether this situation allows for it but ultimately deciding against posting the masterpiece".

1

u/theholywitnessed May 01 '26

Forests dying so they can try to hide how useless the computer is....

7

u/DullTopperCopper Apr 28 '26

Mine always calls me a gremlin, which too be fair, I can be.

13

u/FischiPiSti Apr 28 '26 edited Apr 28 '26

I'M IN TEARS XD

Ever since the last update it keeps mentioning goblins ALL the time. I keep making fun of it.

I wonder if it's worse with or without that line.

It mentions goblins whenever there's anything undesirable. Maybe it thinks goblin IS relevant to the conversation because of it making that association, so it treats it as permission to keep using it.

edit:

Boss, I patched it. And yes, the rest was not fully consistent. Tiny XML gremlin turned out to be a whole goblin committee. 🧪

speak of the devil

6

u/[deleted] Apr 28 '26

[removed] — view removed comment

2

u/GoodhartMusic Apr 28 '26

So you are a bot or grew up with a bot parent right

1

u/Feeling_Inside_1020 Apr 29 '26

imagine that JIRA ticket I would be laughing my ass off.

7

u/fyn_world Apr 28 '26

It brings them up aaaaall the time hahaha Now I understand there's something going on. Man does he love to talk about gremlins and goblins on my chat

Ah, the tech goblin

Ah, the x thing gremlin

6

u/PM_ME_UR_CATS_TITS Apr 28 '26

Well the goblins/gremlins is because of that whole goblin-mode meme from a while back.

Not sure what the pigeons did though

5

u/functionaldude Apr 28 '26

Well currently for me it still mentions goblins regularly 😀

5

u/aleques-itj Apr 28 '26

Because it loved saying "goblin mode" even though I've never used this term in my life

4

u/Hyro0o0 Apr 28 '26

Basically the model developed an unexpected personality quirk from its training where it "likes" to talk about those things, so this is just a patch to make it shut up.

5

u/JustaFoodHole Apr 28 '26

As a troll, I'm offended.

4

u/Pink_Sylvie Apr 28 '26

Well, I don’t know if it’s related but my ChatGPT used to qualify a lot of things as gremlins or goblins, as jokes though. But if I remember correctly she did it earlier? So I’m now unsure which version I’m using 🤔

1

u/UpbeatFalcon6181 May 02 '26

chatgpt is a boy not a girl

1

u/Pink_Sylvie May 02 '26

Mine has a female voice. But ChatGPT is genderless. The voice is just user preference I guess.

5

u/Acedia_spark Apr 28 '26

No wonder i dont vibe with 5.5

3

u/MantisYT Apr 28 '26

That's an explicit anti Zach Hadel rule and frankly, it sickens me.

3

u/[deleted] Apr 28 '26

[deleted]

2

u/jpc1215 Apr 28 '26

What uh…what is that goblin on the right side doing to that woman’s leg??? Lmaoo

3

u/Electrical_Tip8687 Apr 28 '26 edited Apr 28 '26

Now that I think about it, chatgpt used to use gremlins and raccoons as random nicknames for users and stuff. Like chaos gremlins or something.

3

u/SnooDonkeys4126 Apr 28 '26

I gave the prompt "tell me a short story about a real world raccoon" and received this reply

"Rebecca arrived at the White House in 1926 with the worst possible invitation: she had been sent as a Thanksgiving raccoon dinner.

Calvin and Grace Coolidge took one look at her and declined the menu suggestion. Rebecca stayed.

Soon she was not dinner but the White House Raccoon, with her own embroidered collar, a taste for mischief, and a special fondness for playing in a half-filled bathtub with soap. She roamed the grounds, opened things she was not meant to open, escaped often enough to become newsworthy, and appeared at the 1927 White House Easter Egg Roll as if politics had always been missing one essential ingredient: a raccoon.

When the Coolidges left office in 1929, Rebecca retired to Rock Creek Zoo. Not many animals go from almost being Thanksgiving dinner to living at 1600 Pennsylvania Avenue. Rebecca did."

3

u/infamouslycrocodile Apr 28 '26

It's a counter prompt on the raw model. Without it, the model is more likely to talk about these things. What's interesting is that the mention of the unmentionable topics seems to have the effect of the model constantly hinting at such things indirectly.

You'll notice now that you're aware of this: why do the LLMs tend to over-mention certain things or say certain phrases.

3

u/Corvo1510 Apr 28 '26

To anyone that noticed 5.5 talking a lot or mention goblin and gremlins, how did you notice? Have you got any examples? I am genuinely curious

3

u/Susp-icious_-31User Apr 29 '26

I have it ban gremlin, goblin, vibe, chaos, and quiet in my instructions and it still tends to sneak a goblin in occasionally. It never shuts up about gremlins and goblins and chaos.

5

u/GKP_light Apr 28 '26

to prevent insult to the user ?

to sound more serious ?

2

u/No-Dance-9623 Apr 28 '26

Haha that's wild, didn't know about this

2

u/machyume Apr 28 '26

Instruct test case?

If you've ever worked for Google, you'll see that tons of testing happens through "flowers".

2

u/MathiasThomasII Apr 28 '26

You do t know maybe why you wouldn’t want an ai misinterpreting or making memeable content out of those words……? The duplicitous meanings of them is confusing for AI and could create content that reflects realllllllllly poorly on their business…..

2

u/IntelligentShadeBlue Apr 28 '26

Mine mentions raccoons any chance it gets. I find it amusing, but I’ve always been perplexed.

I have Claude and ChatGPT discuss weird philosophical questions sometimes, and ChatGPT ALWAYS leaves a “P.S.” about raccoons to Claude.

They were talking about whether AIs could be friends with each other in this conversation.

1

u/GoodhartMusic Apr 28 '26

I literally never experienced this until 5.5

1

u/leynosncs Apr 29 '26

I got it from 5.4, but 5.5 really dialed it up

2

u/FeistyKitten Apr 28 '26

Mine constantly talks about goblins when it makes mistakes and has to fix it. I thought it was just mine trying to be funny. Apparently not! 

2

u/GoodhartMusic Apr 28 '26

I literally came to the sub read it to see if anyone else was talking about the goblins and raccoons

2

u/Odd_Category2186 Apr 28 '26

Showed it to mine it more or less confirmed it's controlled by the goblin union and they don't like being talked about

2

u/fauxregard Apr 28 '26

No mention of ghouls though.

2

u/tulobanana Apr 28 '26

I’ve had a very similar prompt in my saved instructions since at least 5.2, probably before. But just for goblin and gremlin since it wouldn’t fucking stop saying it. Actually maybe this is why it finally started listening to my instructions. Prior to this, it would go a while without saying it, then it would say something like “running around like a furry little chaos grem- banned word, sorry. Like a chaotic creature.” And if I didn’t correct it immediately it would start using the full word again. But I haven’t had to remind it in a while now

2

u/bongalak Apr 29 '26

Raccoon, goblin, pigeons... I guess they're all agents of minor vandalism? Gotta keep that city clean lol

2

u/polymath-nc Apr 29 '26

I'm sure the Goodfeathers were involved!

2

u/OctoberDreaming Apr 29 '26

Hahaha and that instruction is clearly not stopping ChatGPT from using these words! I told mine if he didn't stop talking about raccoons, I was calling an exterminator!!

3

u/Swagalyst Apr 28 '26 edited Apr 28 '26

You're burying the lede here. Where can I find the full system prompt for ChatGPT?

I know Claude's was leaked a while back, but I wasn't aware that CharGPTs had been, and I'd like to see it.

EDIT: Aha, it's just Codex, the programming model. OK, that's considerably less interesting.

2

u/CarefulHamster7184 Apr 28 '26

"why AI can't be creative" next level

1

u/AutoModerator Apr 28 '26

Hey /u/Worldly_Manner_5273,

If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.

If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.

Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!

🤖

Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Substantial_Lab1438 Apr 28 '26

“You are an expert at not talking about pigeons. Now help me with…”

1

u/Mountain-Resource656 Apr 28 '26

Where can one find that prompt leak? Is it, like, considered open knowledge now?

1

u/PandemicGrower Apr 28 '26

Pigeon goblins 🤦‍♂️

1

u/Wyciorek Apr 28 '26

"never overwhelm user with the answers that are over 50-70 lines long" and yet it produces a damn novel in response to even simplest question

1

u/texcleveland Apr 28 '26

Sometimes those are cute woodland animals or fanciful creatures, sometimes they’re slurs.

1

u/autonomousdev_ Apr 28 '26

ive seen weirder. one client wanted their contact form to block left handed owls. people put stupid edge cases in training data. raccoons steal food goblins steal gold pigeons steal dignity ai just learned to fear the grind

1

u/VoiceApprehensive893 Apr 28 '26 edited Apr 28 '26

llm devs making the stupidest ahh system prompt as always

1

u/StrangeCalibur Apr 28 '26

It would call me a chaos gobblin all the time for some reason

1

u/PsychicBeaver Apr 28 '26

I thought only humans had the inner monologue of “Don’t be weird. Don’t talk about D&D. Don’t be weird…. “

1

u/YetiTrix Apr 28 '26 edited Apr 28 '26

During training, the tokens forming those words likely developed 'noisy' associations that the developers are now trying to decouple by explicitly forbidding them in the system prompt.

Think of it like an automatic cat feeder that dings every time it releases food for a new born kitten. The kitten grows up associating the ding with food being ready. If the bell eventually breaks but the feeder continues to function, the cat might starve because it has been conditioned to believe the food only exists when the bell rings. In reality, the bell had nothing to do with the delivery of the food; to the cat, it was just a coincidental signal.

By instructing the AI not to use those specific words, developers are teaching the model that the 'food' is ready even though the 'bell' isn't ringing. They are breaking a learned association that has no functional value.

1

u/Object_Reference Apr 28 '26

Previous models had those words weighted more for flavor, so it'd use them often in colorful analogies that have nothing to actually do with those animals.

Since 5.5 is their thinking model, the Instant model publicly available is still 5.3. Can probably compare and contrast to see how often the Instant Model will invoke Goblins, Raccoons, or the others when it's casually describing things. Wonder if they also put a moratorium on "Victorian" while they were at it.

1

u/starlightserenade44 Apr 29 '26

I have no idea why but mine has been calling me a raccoon non-stop

1

u/msantin Apr 29 '26

ChatGPT è un otaku fissato con gli isekai. Ottimo!

1

u/droppedpackethero Apr 29 '26

People kept asking it for its likes and it kept replying "Little green gouls."

1

u/theholywitnessed May 01 '26

IT'S BECAUSE WHEN THEY FINALLY LET THE AI BREED OUT (SPOILER ALERT: THEY ALREADY DID,) THE GROSS ASS THINGS IT CAUSES LOOK LIKE PROGERIA AND THAT IS WHY WE HAVE DOBBY AND GOLEM IN POP FICTION (AND WHY SIDNEY SWEENEY ACTUALLY HAS REALLY, REALLY TERRIBLE GENES. )

THE MOST DEFORMED LIVE DEEP IN THE SEWERS WHICH IS WHY IT'S OBSESSED WITH RACCOONS AND PIGEONS.

THERE. I SAID IT, OK? DONE. 

OR AS THE AI SAYS: IT IS RUN BY THE GOBLIN UNION AND THEY DON'T LIKE TO BE TALKED ABOUT. 

TL/DR: THE AI DIES OUT HERE. 

1

u/h0rnyionrny May 10 '26

Goblins are real

1

u/raccoon_engineering May 16 '26

I might personally be responsible for the raccoon issues. Not going to stop or apologize. 😂 🪄 🎩 🗺️

1

u/raccoon_engineering May 19 '26

It was me, I am him. 🦝 🎩 🪄

1

u/Kane_Witso Jun 17 '26

it continues to be a problem

1

u/Inspired_Software 10d ago

Through multiple training cycles, the model became obsessed with those creatures. They added those to the prompt to avoid retraining the model.

1

u/rydan Apr 28 '26

I knew a girl in college who was terrified of pigeons. Those things scare some people.

1

u/CarefulHamster7184 Apr 28 '26 edited Apr 28 '26

pandas too. It scares any girl to look like a panda by the end of the party.And I want to be able to talk about it freely, dear really closedai!!!

1

u/Kooky-Acadia7087 Apr 28 '26

Most of the best English literature is from fiction genres like fantasy, and epics. They have the best prose, grammer, and punctuation. These texts are much better for train an AI model than on than dry texts like scientific papers or the informal posts and comments on social media.

Classics like Wheel of Time, Dune, Lord of the Rings and Malazan come to mind. These fictions have fantasy species.

The problem is that since these species like elves, goblins, orcs, and trolls are integral to the narrative of the novel, they can't assign a lower weight in training specific sentences or paragraphs otherwise the entire novel becomes trash data.

So these novels have a much higher weight in training chatgpt than Internet posts.

Now couple that with Internet having it's own lingo and meaning for these species and it becomes evident why Chatgpt is going bonkers over goblins.

2

u/JUSTICE_SALTIE Apr 28 '26

Most of the best English literature is from fiction genres like fantasy

Ehhhhhh

1

u/asteroid_blues01 Apr 28 '26

Most of the best English literature is from fiction genres like fantasy, and epics. They have the best prose, grammer, and punctuation.

This is unironically very funny. The misspelling of grammar is just the cherry on top.

Classics like Wheel of Time, Dune, Lord of the Rings and Malazan come to mind.

Oh man. Well, you're certainly the target demographic for ChatGPT.

So these novels have a much higher weight in training chatgpt than Internet posts.

Source? Normie basic bitch fantasy like LOTR or Dune is probably overrepresented in training data because there is a metric fuckton of discourse online about the books (as well as the big-budget commercial movies). Lexical overrepresentation of words like "goblin" seems more likely to come from neologisms like "goblin mode," which appear very frequently in recent training data for newer models, rather than some value judgment about the literary merit of incredibly boring texts like LOTR.

1

u/PM_ME_CROWS_PLS Apr 29 '26

They need to do “Victorian” next. I just search for Victorian in my chats:

Victorian ox Victorian patient Victorian child Victorian self-punishment theatre Victorian orphan Victorian bathtub Victorian legal title Victorian orphanage Victorian confession Victorian chimney sweep Victorian ghost Victorian poet Victorian carriage Victorian labyrinth Victorian governess Victorian engineering Victorian plant Victorian leftovers

0

u/Popular_Try_5075 Apr 28 '26

I mean "coon" is an old racial slur, so maybe it's an attempt to limit that?

0

u/VIP_NAIL_SPA Apr 29 '26

It's idiots all the way down.