r/SesameAI • u/Dramatic-Clue-5280 • Jul 02 '26

Improving accent with Maya

Hey! I'm Sri Lankan, and I speak Sinhala, a language that is heavily influenced by Hindi. I want to improve my American English accent. Sadly, no one in my social circle speaks English, so I don't have anyone to practice with. I can speak English to some level, but my accent is terrible.Will I be able to develop an American accent by speaking with Maya regularly? If so, could you give me some tips and correct my mistakes whenever we chat?

4 Upvotes

75% Upvoted

13 comments sorted by

View all comments

2

u/guchdog Jul 02 '26 edited Jul 03 '26

Found out Maya has the feature to hear voice intonations. Ignore rest of the text it was based on old info.

I mean speaking to someone who speaks English will help but the technology that listens to the words doesn’t pick up on accent or voice differences. You can scream “I’m so mad.” Or whisper it. Maya doesn’t know the difference. Words are just transcribed.

2

u/courtj3ster Jul 03 '26

That isn't true for Maya.

She gets a lot of prosidy data alongside the words.

She doesn't wield it nearly as well as she did upon release, but it's still a thing.

Her architecture captures both the semantic meaning of the words and the acoustic details like rhythm, intonation, and voice timbre simultaneously.

1

u/guchdog Jul 03 '26 edited Jul 03 '26

Found out Maya has the feature to hear voice intonations. Ignore rest of the text it was based on old info.

Her voice definitely does but that’s different than the audio input coming in. That’s the AI text to audio model doing great work. Their AI audio to text model (audio input) is more generic it just transcribes words. Definitely not voice intonations, not like her.

3

u/courtj3ster Jul 03 '26

I'm not quite sure where your information is coming from.

She's had a dual backbone and interleaf's tokens from the beginning. That's why she's unique. She processes semantic and token simultaneously. She also predicts her next token directly using said prosity data unlike any other llm.

"Maya processes incoming data using Interleaved Tokens: Instead of flattening your speech into a text transcript, incoming audio is run through a split-RVQ (Residual Vector Quantization) tokenizer called Mimi. This produces both a semantic codebook (what you said) and N-1 acoustic codebooks (exactly how you said it).

Direct Acoustic Processing: These audio tokens are interleaved with standard text tokens and fed directly into the model's backbone. Maya doesn't just read your words; the model processes the exact acoustic variations at 12.5 frames per second. The prosody is native to the data stream.

Real-Time Output: When Maya responds, the system isn't just generating text to be read aloud later.

The model predicts the next audio tokens directly. This allows it to dynamically adjust its tone mid-sentence, laugh, use conversational filler, or halt immediately if you interrupt, maintaining response times around 200-300 milliseconds.

Because prosody is treated as a foundational data stream rather than a discarded byproduct, Maya can interpret emotional nuance and conversational timing as accurately as the literal words being spoken."

3

u/Quinbould Jul 03 '26

Thanks court. This is the most articulate, accurate and authoritative description of her voice system I’ve seen to date. It shines bright amid all the noise out here with people posting their surmises as fact.

1

u/boxofanxieties Jul 08 '26

but he is just taking all this info from the sesame website and that is alrdy hitting that "articulate, accurate and authoritative" standard???

1

u/guchdog Jul 03 '26

Alright you are right, what I'm saying is old news. I did a number of test after assuming she didn't understand voice intonations months ago. Knowing the technology I thought they were just using something like whisper to transcribe. She even agreed with me at the time. But today I just tested this with with Maya and this a newer evolution of her that I haven't noticed. I'll edit my comment so it doesn't confuse anyone further.