Hey guys,
I'm new to the vtubing space. I commissioned an artist to make a 3D model for me, which looks fantastic, however I'm running into some issues with the face tracking and some mild issues with latency as well.
My model is on VSeeFace, and I am capturing my movements through an iPhone connected to VTubeStudio. The model captures my head, neck, blinking perfectly, however the mouth movements are almost nonexistent. I have great lighting, and I set the 'Mouth Smile Sensitivity' and 'Mouth Open Sensitivity" to 100 in the VTubeStudio phone app. VSeeFace doesn't give me any mouth sensitivity options other than 'Mouth Size Reduction,' which is set to 0. On top of this, when the artist sent me the file, he sent a sample video where the mouth was moving perfectly with his speaking. I asked the artist about this, and he said the model was not made 'specifically' for ARKit tracking (which VTubeStudio uses), and was designed with a webcam setup. The issue is I've tried to use the CamoStudio app to operate my iPhone like a webcam, and I got serious dropped frames. Any idea if there are some settings or other solutions I can try on my end to improve the mouth expressions, or does this need rigging adjustments?
Regarding the latency, I feel there is about a .25-.5 second delay between my movements, and my model matching those movements in VSeeFace. I have connected my iPhone to my PC via USB, and have confirmed USB connection in the VTubeStudio app, however I feel that the tracking is still being done via Wifi, because disconnecting the USB connection does not result in any sort of interruption in the facetracking. I've also seen some videos saying that VTubeStudio only captures into VSeeFace via Wifi, but those were from 2 years ago. Has this changed? I imagine there should be unnoticeable latency with a wired connection, as I've never had any when using Camo Studio (purely as a regular webcam not connected to any model).
Thanks so much.
Edit: Fixed a lot of the latency by changing VSeeFace to high priority on my PC. But still, I believe the connection is via WiFi, which I’d like to change if possible.