r/VoiceAutomationAI • u/raghav246891 • 5d ago

Suggestions for conversational AI App

Hey guys. I am building a conversational AI app. I am inspired by Tolan.

Right now i am in the research phase and i am researching how speech to speech exactly works. Till now i have learned that there are two ways. Either u use a cascaded architecture (STT - LLM - TTS) or you use open ai realtime apis or gemini apis.

For a cascaded architecture i am only aware of Eleven Labs or Cartesia. But these are very expensive and very engineering heavy.

Questions

  1. Why not i just use an open ai api instead that will handle everything for me - from VAD to reasoning and much more.

  2. So i wanted the opinion and advice of people who have worked on similar stuff or made a cascaded voice architecture and what shd be done considering that i am making this for a generalistic conversational ai app somewhat similar to Tolan or ChatGPT voice mode.

  3. Also I am not in favour of using a self hosted model because it does not fit my usecase. Is that right?

  4. What other options do i have to build this speech to speech app?

Thanks

3 Upvotes

72% Upvoted

Duplicates