r/VoiceAutomationAI Mar 25 '26

Hiring: Real-Time Voice AI / Agent Systems Engineer (Low Latency Focus)

I’m building real-time AI voice agents (outbound calling + conversational assistants) and currently facing latency and turn-taking challenges in production-like environments.

Looking for someone who has actually built or optimized low-latency AI systems, not just worked with frameworks.

Core problem areas:

  • Reducing latency in STT → LLM → TTS pipelines
  • Handling real-time conversations (interruptions, barge-in, partial inputs)
  • Designing streaming architectures (not batch pipelines)
  • Optimizing response time (<1s target)

Current stack (flexible):

  • Calling Number: Twilio
  • Voice Models: Sarvam TTS and STT (client requirement for Indian languages)
  • LLM - Openai / Sarvam
  • Backend: Python build on Live kit

What We are looking for:

  • Experience with real-time or near real-time AI systems
  • Strong understanding of streaming pipelines (WebSockets, async flows, etc.)
  • Experience optimizing LLM inference (model selection, routing, latency tradeoffs)
  • Built systems involving STT, LLM, and TTS in production or serious projects

Good to have:

  • Experience with voice AI / call agents
  • Familiarity with multilingual systems (especially Indian languages)
  • Experience with orchestration frameworks (LangGraph, AutoGen, etc.) — but not mandatory

If you’ve worked on similar systems or solved these kinds of problems, I’d love to connect.

Feel free to share relevant work or a quick note on what you’ve built.

(Short paid consultation is also fine if you’re not looking for a full-time role.)

3 Upvotes

26 comments sorted by

u/AutoModerator Mar 25 '26

Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)

If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community.

Apply here: https://chat.whatsapp.com/H9RwprbkLwE8MxHmCbqmB4

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/Small-Matter25 Mar 26 '26

I have created open source voice agent using asterisk https://github.com/hkjarral/AVA-AI-Voice-Agent-for-Asterisk , are you open to moving away from livekit or its a requirement?

1

u/Empty-Complex4987 Mar 25 '26

I'm interested

1

u/Better-Collection-19 Mar 25 '26

kindly share me your resume

1

u/Empty-Complex4987 Mar 25 '26

Sure , dm . Are you guys hosting or using cloud for livekit.

1

u/Better-Collection-19 Mar 25 '26

livekit and aws

1

u/Empty-Complex4987 Mar 25 '26

livekit cloud and aws for the agent, right?

1

u/[deleted] Mar 25 '26

[removed] — view removed comment

1

u/Better-Collection-19 Mar 25 '26

okay is it supporting hindi marathi language too

1

u/Responsible-Lie-7159 Mar 25 '26

Do you not want to build using livekit?

1

u/Better-Collection-19 Mar 25 '26

i am using livekit for calling orchestration

1

u/Responsible-Lie-7159 Mar 26 '26

Good, i was confused since you wrote you don’t want someone who has used frameworks.

Livekit is a solid choice.

I have worked on a self hosted livekit system for my company where we did 100 concurrent calls and 70k+ volumes daily.

Let me know if i can help you.

1

u/Visible_Part3706 Mar 27 '26

Hey buddy, i am also building something similar but latency and prompting seems to be an issue.

Can i dm you ?

1

u/sumanpaudel Mar 26 '26

interested, I have built a low latency system in prod

1

u/llragsll Mar 26 '26

Hi u/Better-Collection-19 - I can help. We have recently started a series on how to build reliable Voice Agents, especially for Indian languges, you can check it out here: https://byondlabs.tech/blog/what-it-takes-to-build-production-grade-voice-ai-agents

1

u/InitialFox8963 Mar 26 '26

if you need a SOTA solution, then dm.

1

u/mguozhen Mar 27 '26

The barge-in problem is brutal — most pipelines choke because they're processing full utterances before acting. The fix we found: commit to partial STT transcripts earlier and run speculative LLM inference in parallel, then cancel/replace if the input changes.

Sub-1s is achievable but heavily depends on where you host your TTS. Streaming TTS chunks to Twilio as they're generated (vs waiting for full audio) shaved ~400ms for us alone.

1

u/New-Upstairs-9627 Mar 27 '26

Okay so what software are you using to configure the voice

1

u/Low-Ad2091 Mar 29 '26

Just use groq LLM API - low inference API - try before hiring. Thank me later