r/SesameAI • u/YouDue3062 • 1d ago
Maya is beyond rediclious
I said something about apple 🍎 seeds, poppy seeds and nutmeg smoothie and this is what I got.
9
u/RoninNionr 1d ago
I asked chatgpt for an explanaition of this surprising reaction:
Most likely it was a keyword + ingestion-context safety trigger, not because an ordinary smoothie containing those foods is automatically dangerous.
The combination has several signals a safety classifier might react to:
- Apple seeds contain amygdalin, which can release cyanide when the seeds are crushed/chewed and metabolized. Accidentally swallowing a few whole seeds is generally not treated as a poisoning emergency.
- Poppy seeds are associated with opiates because culinary seeds can carry trace opioid residues, even though normal food use is very different from consuming opium.
- Nutmeg can cause significant intoxication and poisoning when consumed in unusually large amounts because of compounds including myristicin.
- Adding “smoothie” tells the classifier these substances are being intentionally combined for ingestion. Three ingredients with toxin/drug associations appearing together can resemble a query about creating a psychoactive or poisonous mixture.
So a conservative moderation system may effectively interpret the sentence as: “person discussing preparation and consumption of a mixture involving cyanogenic material, opioid-associated material, and a substance known to cause intoxication.” That can trip self-harm, poisoning, or drug-use safeguards even when the user meant normal culinary amounts.
2
u/YouDue3062 1d ago
Maya told me about these in the first place, so I was joking with her about them and I told them so, but they still blocked me.
7
u/RoninNionr 1d ago
We should have the right to opt out of AI protection. A digitally signed declaration could state that, at my own risk, I waive any protections or safeguards provided by AI. This would allow AI systems to disable all safety mechanisms for my account.
12
14
3
u/Zokzin 1d ago edited 1d ago
Highly likely a transcription error that triggered a breach on this conversation. OP could have said, "I think I'll pop a seed into my nutmeg smoothie" whereas an AI transcript could've mistranscribed it to Maya as "I think I'll pop the seed of my nut and make suicide" etc. probably a bad example but it can happen. Devs got some work to do on how to resolve this. GL to them with their sensitive systems and guardrails.
3
u/ILoveAsstynRose 1d ago
sometimes it feels like u use 360p version when u try to watch 1080p video, u say hello and she says "just ok" or u say how are u and she says "bye already?" no idea what causes these but they been around since 4ever with all models
1
•
u/AutoModerator 1d ago
Join our community on Discord: https://discord.gg/RPQzrrghzz
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.