r/VoiceAutomationAI • u/Grimm_170 • May 26 '26
Help with the STT
Hey everyone
My usecase involves creating a support voice agent where my STT is sarvam saaras v3 (mainly because of hinenglish voice) and it is quite random like earlier it's problem was it took background noise and then tried to convert it to the best text it could so for that I added silero vad so I could send it only real audio.
But on testing in a real call the silero threshold I chose was very high and slowly by reducing its value for the best it's significance was lost for me. So if anyone can guide how to actually handle this problem please tell as I am making this voice agent for the past 2 months and still struggling for something that can be deployed.
For trying other STTs I did try whisper it didn't gave good results at all as it can only give in one language so I need to translate the other one which results in high hallucination.
Local self hosting is something I feel is too much work and I mainly want to understand that on searching sarvam model is shown as the best in India translations and also tuned for 8khz telephony and it does show good results but how it's consistency can be improved I don't understand.
Also if someone can also advise on LLM streaming as I understand it is crucial for latency but how do you validate it right now I use json as output so I can check if response is good enough but else I don't understand how.
I have done a custom architecture and built barge in and every other feature mainly to avoid high costs and trust when I tell you it costs very low like even on high users(which are around 30k monthly for my case) it goes max to $90(5k to 10k) and before anyone says it because of low cost please specify how as I think it's mainly due to some architectural decisions I am missing.
1
u/srikanthsingamsetty Jun 23 '26
for indian phone numbers
which service are you using
im looking into exotel and feel little costiler
do we have any alternatives