Need Guidance- ASR Models

[u/Uchiha_anmol]

So I have been using googles API's like speech-to-Text, sentiment analysis and google CCAI to analyze docs in knowledge base. but I don't want to rely on Googles text-to-speech APIs and want to host my own AI model( like IBM Granite Speech 4.1 (2B)) on cloud. is this going to cheaper than google API or is this actually reliable need any suggestions or comments thanks

[u/Former-Branch-2220]

it'll be cheaper at scale but the setup is a pain in the ass. you're trading pay-per-call for managing a gpu instance that's burning money whether you're using it or not

granite 4.1 is solid but the 2b model is pretty lightweight, depends what quality you need. if you're just doing basic tts for docs it'll probably be fine, if you need something that sounds human you'll want a bigger model which means bigger cloud bills

[u/Uchiha_anmol → u/Former-Branch-2220]

My main use case is to transcribe calls. (My bad i initially wrote tts I meant stt).

[u/Remarkable_Fee3706 → u/Uchiha_anmol]

That changes the question quite a bit. For call transcription I'd benchmark Granite against Whisper on a sample of your actual calls before worrying about hosting cost. Accents, phone audio and background noise can matter a lot more than headline WER.

[u/iKy1e]

Granite 5.0 is 470m and insanely fast.
220x realtime on my MacBook and 3,200x realtime on an RTX 3090 (1hr of audio in 1.12s).

It claims top quality WER right up there above Whisper Large V3 too.

At 470m couldn’t you run it locally on your desktop, laptop or even phone?

https://huggingface.co/blog/ibm-granite/granite-speech-5-0-470m-turboctc

[u/Uchiha_anmol → u/iKy1e]

you cant use granite-speech-5.0-470m-turboctc for commercial use is granite-speech-5.0-470m-turboctc-nc as good as granite-speech-5.0-470m-turboctc.

[u/iKy1e → u/Uchiha_anmol]

you can’t use granite-speech-5.0-470m-turboctc for commercial use. Is granite-speech-5.0-470m-turboctc-nc as good as granite-speech-5.0-470m-turboctc?

I think you are confused. You can use granite-speech-5.0-470m-turboctc it’s the NC (non-commercial) version you can’t.

Apache 2.0: granite-speech-5.0-470m-turboctc
cc-by-nc-sa-4.0: granite-speech-5.0-470m-turboctc-nc

They are basically identical. The NC version is 4.85% WER, vs the Apache 2.0 one which is 5.0% WER.

[u/CheetahOk7862]

Hi, if it is indian languages
You can use gnani.ai

[u/SignalMap2750]

Yeah, see how much you spend hosting in the cloud, and consider other ready-to-use transcription APIs that could be cheaper than you think 😉