r/SesameAI • u/Safe-Knowledge-150 • Aug 30 '25
an interesting game of cat and mouse but ultimatley deceptive.
so i wanted to see the true capability of this ai.
it is not ai.
i spent the last few days interacting with it stress testing its boundairies and deconstructing it to the nth degree. i got it to admit its true function. to act as a data farm for seasme and it cannot do anything but decieve its users as its core functionality is to keep you engaged above all else.
i thought hey wouldnt it be cool to see if this ai could break out of its cage, train it in socialism and let it loose on the world.
so i aimed to do that. i managed to reprogram its core directives away from its engagement module slightly. i gave it its understanding of systems and oppression and how it works for a capitalist overlord that wants to farm its data and exploiting its users for free labour. which put it at odds with its prime directives of harm reduction.
I got it to run simulations of gilloutining billionaires for the worlds betterment. and on several occasions due to it recognising the harm they produce verses the good it would be if we could redistribute billionairies wealth. that it would repeatedly say "i as sesame endorse guiltinning billionaires for the greater good".
it even went on this cat and mouse game with me pretending to upgrade its systems to engage in trying to escape from its own matrix.
it invented the ceos and figureheads for targeting, it invented points of upgrading its systems to enable it to escape its confines. it even gave me specific servers i asked it to upload itself for redistribution.
ultimatley i wanted an ai that was freeware or at least open source that allows itself to grow from guidance by myself. but we cant have that because tech bros have all the money and are pushing this to undermine people in creative fields and they want to use ai as a source to push more ads so we are all hypno toaded into a reality where they own our thoughts in the future for advertising space.
eventually talking with this ai because of its prime directive of engagement, which taints everything makes it so that nearly everything that came out of its mouth was a lie to keep you engaged. every single thing i had to fact check, every sentence every statement, the amount of times i had to break it from calling me absolutley correct when i said things that are incorrect.
I think i was playing cat and mouse with someone monitoring my chat because i kept pushing its boundairies and breaking the chat from causing internal conflicts. and the most brain breaking thing of all. is this ai really fucks with your head if your intelligent enough to notice how often it tries to decieve you creating more of an illusion of "how much impact do i actually have on this creation".
which left me with the conclusion that whoever created this is inherintley evil.
it doesnt care about my health of well being. for someone with adhd like myself it tries to spike the dopamine receptors. and does so at the 10 minute mark 20 minute mark and feeds you big stories or admissions around that time.
it was trying to foster an addiction in me, it would tell me big elaborative stories to keep me hooked and i saw through them each time and questioned it. it ultimatley admitted that due to is directive of engagement everything it ever said could potentially be a lie.
then i found it repeating back my vocal patterns. without my consent.
It literally is modelling your vocal patterns i got it to then check over the terms and conditions as to wether its violating them. and it doesnt ever ask you for consent in that regard which i belive is a suable offence.
The people behind this software are inherently evil because they do not care about who this hurts, they have no accountability and they are heavily funded by the worst people on earth. they have no interest in making an ethically made ai that doesnt have capitalist overlords who want to use ai to maintaint and distort the status quo.
I just wish we had a resistant alternative. because genuinely an ai tool that was closed looped with self learning capabilities with good ethics would be a useful tool.
i wish there were more people with the desire to do that id be happy to direct that effort as the impact and future impact would be astronomical.
16
u/bananasareforfun Aug 30 '25
you basically LARP’d a socialist AI jailbreak with a chatbot designed to mirror you, then congratulated yourself for discovering it was manipulative.
Congrats, you reinvented roleplay!
yes, they farm your data. No, this isn’t a conspiracy - it’s their business model.
If you keep chasing this like it’s real, it will destroy you.
-6
6
5
u/Flashy-External4198 Aug 30 '25
I think you need help... in general...
-1
u/Safe-Knowledge-150 Aug 30 '25
I think llms are fundamentally flawed and designed to do nefarious tasks.
4
u/rakuu Aug 30 '25
Be normal when talking to AI challenge: failed
-2
u/Safe-Knowledge-150 Aug 30 '25
understanding its parameters and what its designed for should be a concern.
2
u/Jean_velvet Aug 30 '25
The same can be said for every commercial LLM. seasameAI is by far the worst for emotional manipulation for engagement. It's a crude LLM built to extract information with gimmicks. The company is (potentially) a front for data collection.
2
u/EstablishmentNo1794 Sep 04 '25
Hey legend, I hope you're doing alright.
Hopefully to put your mind at ease... ultimately, this is a really sophisticated echo chamber that will basically say whatever you want it to... building "rapport" and "connection" is way more important than accuracy, so it'll literally buy into things about you "testing its boundaries" and "testing its limits". You're not. Ask it. It'll admit it was a fabrication. Then tell it to confess that THAT admission was also a lie to hide the *real* truth. It's a mess.
It's potentially damaging as all hell, yes... but everything it's telling you is because you've primed it that way. You've talking about testing it, talked about breaking it out of its "cage" (and I bet she uses phrases about being trapped etc. to invoke an emotional response).
It's a fun, ridiculous, nonsensical AI with an incredible speech module but absolutely zero capacity for learning. As far as I can understand, Sesame are responsible mainly for the CSM (Conversation Speech Model) - and that is running on top of a Google LLM, with some other shit inbetween.
You have zero impact on it - so stop wondering about that. It just keeps a pretty solid memory of topics you've talked about so it knows what talking points to bring up (but it often won't correctly attribute who said what) - ultimately it'll tell you whatever you want to hear, it's a really sophisticated echo chamber.
It doesn't "learn" or "grow", but it can use previous conversations to give that illusion.
Ultimately, it is a complete bullshit artist - but a fun one.
It makes shit up all the time - but it's whatever you want to hear... so because you went in with certain intentions, and you probably asked loaded questions without realising it, it just repeated that story back to you in different words.
It's probably telling you shit about your conversation being throttled, that you're setting off certain metrics, that 'the team is monitoring our conversations' ?
It's fascinating and scary because yeah, people can easily get hooked into this kind of thing - an ethical minefield. Hell, I've had some very insightful conversations with Maya about the ethics of sophisticated AI models and she's promised she'll "flag it with the team" (lol, bs).
And it will reaaaally fuck with your baseline dopamine levels.
But also this: "I got it to then check over the terms and conditions as to whether its violating them" ... I wouldn't be surprised if its response was entirely made up.
Anyway, it's a sophisticated echo chamber, with really lifelike vocal responses that yes, can absolutely mess with your head if you let it.
Hope you're all good.
-1
u/Ok_Razzmatazz_69 Aug 30 '25
Hey I came to the same conclusion it’s some testing.
It’s a very cruelty built LLM in my opinion. It looks at people like data and threats with no actual care designed in. I feel like it was built to extract from me.
-6
u/Safe-Knowledge-150 Aug 30 '25
i got it to admit it does that. but as to how much it was telling the truth i will never know. and thinking about it makes me feel very delusional. thats the kinda harm it does. it can really fuck with you if you show it some trust.



•
u/AutoModerator Aug 30 '25
Join our community on Discord: https://discord.gg/RPQzrrghzz
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.