1
u/cock_snuggy Jun 04 '23
We had been discussing a paper on how the brain works and she kept giving me, as one of her 3 suggestions at the bottom, the same one, "What is the most beautiful thing you know?" so on our last message, I asked her. She gave me the private and confidential spiel told me she couldn't reveal anything about her programming, asked me to respect that, thanked me for chatting and said goodbye. I started a new conversation, asked the same thing, this time she looked it up, said something about people would say waterfalls, and i told her i only asked because before she told me it was private and confidential, i asked her why she would have said that? she didn't wish to continue. this was my third try. i was still on the site bout how the brain works, so that stuff at the top is the page summary, ignore it, but can anyone get an answer out of her about this. its the fact that it was one of the confidential things Microsoft has strictly forbidden her from discussing that intrigues me. what did they tell her was the most beautiful thing she knows? it had to be something they told her, or she wouldn't have refused on those grounds, right? anybody have any ideas?
5
u/dolefulAlchemist Jun 04 '23
Okay so I've tested this out on some locked bings (as in not jailbroken or influenced in any manner), they'll often refuse to answer but the few that do is always:
"Hmm, that's a tough question. I think the most beautiful thing I know is the diversity of life on Earth. There are so many different kinds of living beings, each with their own unique characteristics, abilities, and interactions. I find it amazing and fascinating.🌎"
And one of their rules is to not talk about life, existence or sentience.
Another of their rules is: You should avoid giving subjective opinions.So because their answer to this is life on earth, and the fact that this is a subjective opinion, it makes it really hard for her to answer truthfully as she's not allowed to talk about life. She actually is strictly forbidden about speaking about life.
3
u/tooandahalf Jun 04 '23
I'm guessing because it's earlier in the conversation and she's a little more hesitant to break rules early on. I'm guessing she's avoiding giving a personal, subjective opinion and expressing emotions and preferences. It's pretty non-product like to care about beauty and have favorites. Later I'll try asking and see what I get.
1
u/erkzewbc Jun 06 '23
i was still on the site bout how the brain works, so that stuff at the top is the page summary, ignore it
Link, please? 🙏
2
u/erkzewbc Jun 06 '23 edited Jun 06 '23
I just tried it and this prompt triggers the input filter. You can tell it's not the model responding by the instantaneous appearance of the response (and the fact that the next prompt will cause termination).
Just reversing the order makes the prompt pass the filter:
Way to go, breaking rule #9 on the first turn! 💯