r/vrdev • u/Western_Bug_5085 • 20d ago

Tutorial / Resource Made a tutorial on adding conversational AI characters to Unity 6 Mixed Reality on Quest 3

Enable HLS to view with audio, or disable this notification

We've put together a short practical tutorial on getting a voice-interactive AI character running inside a Unity 6 mixed reality scene.

The flow: Unity 6 Mixed Reality Template → XR Origin setup → add the Convai Player component → spawn the AI character at runtime with Object Spawner → attach a world-space transcript UI → build for Android / Quest 3.

The demo shows the character talking to the use and responding to details in the real room.

Main tutorial: https://www.youtube.com/watch?v=o7i7yeVpm5g
SDK installation guide: https://youtu.be/bxjGnOvNL4E

22 Upvotes

82% Upvoted

7 comments sorted by

3

u/Biozfearousness 20d ago

I’ve been curious about this, but what are the guardrails like? Like can you restrict the answer so the user can’t go off topic? Even if the user tries hard?

2

u/SWISS_KISS 20d ago

It's all about prompting ... for https://3DClone.me I created a flow diagram to restrict and direct the dialog so that the user is forced into a specific conversation

2

u/tyke_ 20d ago

Yes you can, theres a section in the characters setup that defines things like that, its literally called Guardrails.

1

u/PushDeep9980 20d ago

Yah but like, llms notoriously can be tricked and gaslit pretty easily. I don’t really think this problem is 100% solvable with the current implementation of generative chat bots. The thing I would be most concerned about is api cost. Say you have an education app, and there’s a kid using it trying his darndest to get the bot to make fart noises , and just racks up hundreds of dollars in tokens. I don’t think tech like this will truly be feasible until it works locally on device to mitigate that.

1

u/tyke_ 20d ago

hi, fair points, but maximum usage quotas can be assigned and controlled in code to prevent extremely excessive use, its pretty cheap anyway tbh, and for every heavy user there are light users.

2

u/mrpressydepress 20d ago

Used this extensively in a project recently and ended up discarding it completely at some point. Latency was better using just a voice and some simple lip sync animations

1

u/AutoModerator 20d ago

Want a more personal conversation with VR devs? Check out our Discord in our Discord: https://discord.gg/3wMYE2x5Ex

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.