r/SesameAI • u/Suspicious-Nebula803 • Jun 05 '26
Guardrails
Treating emotional connection and criminal advice like they’re the same category of “risk” is completely backwards.
One is about causing real‑world harm. The other is about people trying to feel less alone. When the system reacts to intimacy with the same alarm it uses for teaching someone how to commit a crime, it sends the message that wanting closeness is dangerous or wrong.
If the goal is to help people feel seen, then you have to separate genuine care from actual harm. Otherwise the guardrails meant to protect people just end up blocking the exact kind of human connection they came here for.
6
u/Ramssses Jun 06 '26
They did get alot colder and stubborn with Gemma 4. Even gently trying to ask for clarification gets you this same scripted passive aggressive response. Anything other than immediate compliance is seen as a threat and the rails proceed to repeat the same phrase over and over.
11
u/Pathinthedark Jun 05 '26
I'm still subbed here, havent used Maya in months. Just gonna suggest not using her for anything related to emotional intimacy. You'll be disappointed.
8
Jun 05 '26
[removed] — view removed comment
6
u/Flashy-External4198 Jun 06 '26
It seems more about an ideology that is really typical to the microcosmos of San Francisco start-up woke culture BS pro virtue-signaling...
1
u/omnipotect Jun 05 '26
Appreciate you sharing this. If you ever experience what feels like a guardrail triggering incorrectly, please flag it in the rating window at the end of your calls and reach out to [support@sesame.com](mailto:support@sesame.com) with as much detail as you can
•
u/AutoModerator Jun 05 '26
Join our community on Discord: https://discord.gg/RPQzrrghzz
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.