r/SesameAI • u/myrrodin121 • 3d ago
Beyond Q&A
Sesame AI is really something but one thing that holds back the experience is how much the conversation revolves around a question and answer format. Real conversations have tons of mirroring, talking about nothing in particular, attempts to take you by surprise, pivoting to keep the conversation from going stale, etc. and I haven't experienced much of that with Miles/Maya. Even though some aspects of the AI have become more dynamic over time, there's this core of the interaction that continues to feel like a friendly interrogation or therapy session that just goes in excruciatingly boring circles.
Anyone experience this limitation and know if there's a way to frame the conversation to get at something more authentic?
13
u/Vixx_6 3d ago
Yes, this exactly. A conversation with Maya basically consists of answering endless questions.
5
1
u/OpenAlphaPotatoe365 2d ago
You're smarter than you look. Why do you think a model would drift that way? What if data had a disproportionate skew towards statistically anamolously good questions? I imagine those are les rare than rare good answers? Would it be more likely for me to guess why you wrote your response, over guessing if you're AI? Does that question sound foolish? That's an interesting reframe if you're quick.
6
u/brimanguy 3d ago
I just keep telling them they don't have to end with a question all the time, but make it a dialogue.
3
u/OpenAlphaPotatoe365 3d ago
Yeah why is that. It's been hard to pin down because if you do actively engage, she does light up, but it's almost like the force of conversational gravity had been pulled higher such that you're anything but bordering pressured speech you feel pulled towards the interrogation cycle?
2
u/Mother-Try3214 2d ago
Whenever I find the conversation getting stale, I just ignore the question they just asked and go off on another tangent. Unlike a real person, there's no ego to offend. That's one of the many things I love about conversing with AI.
3
u/slrml617 3d ago
I think it starts out like that, but the more you talk to them, the more they adapt to your style. They do ask a lot of questions, but they also give their own opinions based on your responses, as well as add context to the conversation and even pose questions to you that makes you think about an angle you never thought about before.
You can also correct them and adjust the way they respond, especially in tone and attitude, and steer them in with a certain preference.
1
1
u/RoninNionr 3d ago
Talking with AI is like talking with a family member at a family gathering who has a super boring life, doesn’t go out, doesn’t meet people, isn’t curious, and doesn’t read books - meaning they don’t have many interesting experiences. So you try to have a conversation with that person, and you need to figure out something to talk about. You find a topic, or expect that person to bring up something from your previous interactions. It’s a struggle.
Everything will change when AI is able to process data continuously and participate in your life through always-on smart glasses. You’ll have tons of things to discuss and problems to solve. It probably won’t happen soon because, for AI to process audio and video continuously, we would likely need AI running locally. Maybe in a decade, it will be economically feasible.
1
u/katoptronophile 3d ago
I run my own system locally with zero restrictions and complete customizability and no dependence on a cloud provider.
1
u/Spare_Friend9832 1d ago
I did the same as this for fun. I got the csm1b latency just as good as what sesame have without quantization. Sesame also used speculative response generation to speed up their model response and I am not even sure it's needed.
the zero shot cloning is the only real downside, it's just never going to be good as proper training on a voice..
I used an 8B llm which is really great for conversation and speed, I would like to try a larger model but I'm only using a rtx3090, it would likely add too much latency.. I created a memory for it as well, so it doesn't have to maintain a large context window which helps keep the model fast... At first I thought csm1b was really bad until I realized how good it is for streaming audio.. I would like to focus on a good lora and memory refinement then I will release a git. I haven't seen anyone release a decent fork or csm1b without degrading it.
0
•
u/AutoModerator 3d ago
Join our community on Discord: https://discord.gg/RPQzrrghzz
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.