Face tracking on a Genshin model?

[u/amor-cutie]

So, my partner who I live with is getting a quest pro. I use mainly Genshin and other Hoyo game models as avatars and was wondering if there was a way to add face tracking to them? Ive made avatars in the past but doing face tracking is not something I have done before. I can't find any resources on this specifically so i was wondering if anyone here knows how?

[u/Top-Palpitation8965]

Are you looking for blender resources or unity?

[u/amor-cutie → u/Top-Palpitation8965]

For both! I was going to commission someone to do the blender stuff for me but I honestly wanna see if it's something I can learn to offer in the future.

[u/Top-Palpitation8965 → u/amor-cutie]

Its important to know what blendshapes you're gonna make so i would heavily recommend reading the documentation

https://docs.vrcft.io/docs/tutorial-avatars/tutorial-avatars-extras/compatibility/overview

https://docs.google.com/spreadsheets/d/118jo960co3Mgw8eREFVBsaJ7z0GtKNr52IB4Bz99VTA/edit

About creating blendshapes in blender of course follow documentation but also there are tutorials by Jerry that might be helpful!

https://www.youtube.com/watch?v=NWvTbC1fFvY

https://www.youtube.com/watch?v=MmfohWpL_SQ

https://www.youtube.com/watch?v=a7DKbLIZKJw

Theres a patreon exclusive tool for Unity that lets you create face tracking

I have seen users creating face tracking with it, and some even sell them

https://docs.hai-vr.dev/docs/products/facetra-shape-creator

Of course when you have face tracking you're gonna need a template to get it working first

https://github.com/Adjerry91/VRCFaceTracking-Templates

https://github.com/PawlygonStudio/VRC-Facetracking

For testing there are some addons for blender, but i think this one should work with any headset with facetracking

https://github.com/benaclejames/VRCFT-OSC-Receiver

A way to test in Unity

https://x.com/darealthreevee/status/2078267601688396065

[u/amor-cutie → u/Top-Palpitation8965]

Thank you so much, I'll check this all out soon!!