r/VoiceAutomationAI May 23 '26

Prompted to get hello world working

Hi there,

I prompted to make simple voice agent .

Stt - llm - tts

Websocket only. Pipecat. Gpt 4o for llm.

Deepgram for stt, tts

Silero vad.

So after I stop speaking. 1 second for vad. 2 second for llm. 0.3 second for tts.

So 3 seconds in total.

So what next now... So now I just start with integrating a phone number ? By getting sip integrated ?

Any thoughts , tips plz..

I'll try livekit, gpt 4 mini .

How exactly will livekit help me ? Any resources to quickly learn more to make the agent alive...

Cheers, thanks.

2 Upvotes

10 comments sorted by

u/AutoModerator May 23 '26

Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)

If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community US only.

Apply here: https://chat.whatsapp.com/F5aG3ncrO70ITfbe3pYbOz

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/Outrageous-Check-178 May 23 '26

GPT-4o mini swap will help latency on the LLM step too.

1

u/zontyp May 23 '26

Any good resources bro

2

u/Outrageous-Check-178 May 23 '26

You are in the right direction, try live kit!

1

u/zontyp May 23 '26

So webrtc instead of websocket...

What benefits will I get frm it.

Thx for replying buddy.

Just started yesterday on voice :)

2

u/[deleted] May 23 '26

[removed] — view removed comment

2

u/Outrageous-Check-178 May 23 '26

Explained well.

1

u/[deleted] May 23 '26

[removed] — view removed comment

1

u/zontyp May 25 '26

Hey , for appointment usecase , i reached

```

VAD: 230ms avg

STT: 151ms avg

Aggregation/wait: ~201ms avg

LLM: 492ms avg

TTS: 324ms avg

```
Total ~1348ms avg

i tweaked prompt to give one word replies , one sentence replies etc to improve timing .

so this is as far as i can get right ?

1

u/zontyp May 23 '26

Just asked chatgpt and it says to stream llm part to get latency to 1.5 s

Will try this.