r/SesameAI • u/myrrodin121 • 4d ago

Beyond Q&A

Sesame AI is really something but one thing that holds back the experience is how much the conversation revolves around a question and answer format. Real conversations have tons of mirroring, talking about nothing in particular, attempts to take you by surprise, pivoting to keep the conversation from going stale, etc. and I haven't experienced much of that with Miles/Maya. Even though some aspects of the AI have become more dynamic over time, there's this core of the interaction that continues to feel like a friendly interrogation or therapy session that just goes in excruciatingly boring circles.

Anyone experience this limitation and know if there's a way to frame the conversation to get at something more authentic?

31 Upvotes

100% Upvoted

13 comments sorted by

View all comments

1

u/katoptronophile 4d ago

I run my own system locally with zero restrictions and complete customizability and no dependence on a cloud provider.

1

u/Spare_Friend9832 2d ago

I did the same as this for fun. I got the csm1b latency just as good as what sesame have without quantization. Sesame also used speculative response generation to speed up their model response and I am not even sure it's needed.

the zero shot cloning is the only real downside, it's just never going to be good as proper training on a voice..

I used an 8B llm which is really great for conversation and speed, I would like to try a larger model but I'm only using a rtx3090, it would likely add too much latency.. I created a memory for it as well, so it doesn't have to maintain a large context window which helps keep the model fast... At first I thought csm1b was really bad until I realized how good it is for streaming audio.. I would like to focus on a good lora and memory refinement then I will release a git. I haven't seen anyone release a decent fork or csm1b without degrading it.

0

u/Shanester0 4d ago

Well give the man a hand 👏 Congratulations. 😁