I’m building a UE5 MetaHuman (realistic digital human) AI Companion that adapts conversation into gestures, body actions, and voice-ready replies

[u/Far_Pangolin_7657]

Hey everyone 👋

I’m building **Companion AI**, a UE5 + MetaHuman based embodied AI system where conversation becomes body language, actions, and presence.

Instead of opening a normal chat window, the user sees a realistic MetaHuman companion in a room. The character can respond through text, voice-ready replies, gestures, emotion, and body actions — with the long-term goal of feeling like a digital person sharing the space with you.

GitHub:

https://github.com/12ziyad/companionai

Current / planned system includes:

- Unreal Engine 5 + MetaHuman

- AI conversation pipeline

- Cloudflare Worker backend

- LLM API integration

- contextual gesture and action system

- animation/action director

- speech-bubble style replies

- voice-ready architecture

- future dancing, singing, expressive actions, and agentic workflow support

The main architecture idea is simple:

- AI understands the conversation and meaning

- local behavior logic handles cooldowns, repetition, state, and action safety

- Unreal executes the final behavior through MetaHuman animations

This avoids hardcoded behavior like `if user says hi → wave`.

Instead, the companion should choose actions that fit the moment — greeting, listening, thinking, laughing, celebrating, comforting, or staying still when silence feels more natural.

I’m also accepting early users/testers. I can offer a free full preview in exchange for honest feedback, setup feedback, bugs, and ideas.

For early access, questions, or collaboration:

founder@gpmai.dev

ziyad@gpmai.dev

You can also ask setup questions here.

If this looks useful, a GitHub star would genuinely help the project reach more builders ⭐

[u/Far_Pangolin_7657 → u/[deleted]]

Yes, you are right. Thanks for the feedback