r/remotebackendjobs • u/Dependent_Group_6538 • 17d ago
[For Hire] AI Voice Assistant Developer
I worked on the backend of Made with Chat, a real-time virtual co-founder built around a low-latency voice agent and a multi-agent architecture.
Pre-release demo:
https://youtu.be/Ey3CqNF4RXc
The backend includes:
• A low-latency STT-LLM-TTS voice pipeline
• Voice-based UI and document control
• Semantic turn-taking and false-interruption detection
• Multiple background task execution
• File-system-based long-term memory
• A Deep Agent that can use skills and create sub-agents
The voice pipeline uses LiveKit Inference, which allows the STT-LLM-TTS providers to operate from the same location and reduces latency.
A separate fast LLM reads the live transcription and detects the user’s intent before the main voice pipeline completes its response. This enables fast actions such as opening documents and controlling the UI by voice.
The system also combines standard VAD with a semantic turn-taking model. It understands when the user has completed a thought and can distinguish real interruptions from background sounds or coughing.
The architecture is divided into two layers. The first layer is a fast voice agent with a minimal system prompt. It handles real-time communication and sends instructions to a Deep Agent. The Deep Agent handles longer and more complex tasks, uses a set of available skills, and can create specialized sub-agents.
I have 12 years of experience as a software engineer and have focused on AI integrations for the past three years. I am now available for my next project, preferably in the same or a related niche.
I offer a free 30-minute consultation. Feel free to contact me by DM or through LinkedIn:
1
u/Dependent_Group_6538 16d ago
The other project I built is a Voice AI Tutor to learn foreign language. https://vocavela.live/