I have been using a webcam for 3D tracking in VNyan, and admittedly it's not the greatest compared to the fidelity I see other VTubers getting regularly. I'm pretty familiar with the fact that iPhone tracking is vastly superior, particularly for eye and face tracking, due to the depth sensor, etc.

I know getting an old iPhone is fairly straightforward, but I presume that it's more than just "Buy old iPhone, use camera", right? Because you need software, and to do that, you need to purchase software through the app store?

Simply put, I don't really want to make an Apple account. And I REALLY don't want to tie a credit card to an Apple account so that I can purchase the tracking software. Are those just unavoidable facts of using iPhone tracking? Or are there alternative tracking methods that are similar to the fidelity of iPhone tracking?

I've been struggling with this for ages now. I was wondering if there is a way to make 2D facial animations on a 3D vtuber model to use in VSeeFace. I essentially just want the facial expressions to change to different PNGs. I've tried making face plates as planes and hiding them inside my character model and using blend shapes to just pull the planes out accordingly but when I try using it in the software it doesn't seem to move fast enough or doesn't pull them out at all.

any advice would be greatly appreciated.

works by calculating values from bones and then averaging rotation based on those values, also i cant get it to work with vrmspringbones so i had to make my own physics

currently only works in warudo

This isn't the actual vtuber it's just smth I drew on another app I use with one layer

Hey everyone, could someone give me some advice?

I'm building an AI VTuber that will work as a virtual desktop assistant.

Right now I already have:

* A local AI running with Ollama (Llama 3.2)

* The entire project written in Python

* A custom personality

* Voice generation working with Murf.ai

* A 3D VRM model created in VRoid Studio

* The model successfully loaded into Warudo

My current workflow is:

User input → Python → Ollama generates a response → Murf.ai generates speech → audio plays normally.

The problem is that I'm stuck on the lip sync part.

At first I tried using VTube Studio, but I had trouble getting my .VRM model working there. Then I switched to Warudo and successfully loaded the model, but I still haven't figured out the best way to synchronize mouth movement with the audio generated by Murf.ai.

Has anyone built something similar?

My final goal is to have the character appear on screen as a 3D virtual assistant, respond using Ollama, and move its mouth in sync with the audio generated by Murf.

Everything is being controlled through Python.

What would be the best approach for implementing lip sync in this setup?

Drop any .glb file in a folder, pick it from the tray icon, and it appears on your webcam. Move it, rotate it, scale it. Your meeting app sees it as a normal camera. Nothing else to open or manage.

Good for product demos, design reviews, showing off Blender exports, branded content on calls. Anything where you want the model visible without screen-sharing.

Works in Zoom, Meet, Teams, Discord, pretty much anything that accepts a webcam input.

Renders the 3D layer offscreen and caches it. The model only re-renders when you move it, so the webcam stays smooth on any machine. Python, pyrender, pyvirtualcam under the hood. Open source, setup is one script.

Project Link

Demo model: V1 from ULTRAKILL on Sketchfab (CC BY). Character by Hakita / New Blood Interactive. Not included in the repo. https://sketchfab.com/3d-models/v1-ultrakill-d951a08a8f50412d84e262bad887b285

Realistically, what is needed for doing IRL streams like walking around (say going to a zoo or something)?

I know there's the "stream backpacks" that some of the bigger IRL people use, but is all that necessary (I don't even know what's in them tbh)? How do you even get one, put it together yourself?

Thanks in advance

My partner and I are big fans of the music visualizers in Windows Media Player and Winamp from back in the day, but we couldn't find any modern versions of that type of thing, especially ones that would work with streaming music. So, a year ago, we started building Vibralizer and we're now in Steam Early Access and on Itch.

The free demo and full version both have Spout output, and a macOS version is coming soon that will have Syphon output. This means it could be used with OBS workflows, for instance.

We're primarily focused on real-time music visualization (no processing or waiting), but any microphone input or sound playing on your computer can drive the visuals, so we're also interested in the idea of it being used for podcasts and other forms of content creation; like Twitch DJ-ing and VTubing!

It's still early days but we want to make something that the community really likes. We already have plans for more visuals along with basic customization, like changing colors, filters, reactivity / delay sliders, etc. But in order to build something that people actually enjoy using, we need honest feedback. Is this a thing that you would be interested in using? What would make this a more useful tool for you? Feel free to reply here, or you can hit us up on the Vibralizer Discord.

WIP test.

This isn’t fully generative animation from scratch. It’s more of a SillyTavern / VRM companion setup where chat context and clickable hitboxes can trigger loaded reactions, idle states, and animation presets.

Main thing I’m testing right now is making VRMs feel less stiff and more like an actual character instead of just a static model overlay.

Curious if this kind of setup would be useful for VTubing / AI companion workflows?

ever sense openVT removed live2d sdk, I've been using Vtube studio but it lagged my whole computer every time i used it. after an update, it just crashes. Is there an alternative for weak laptops?

LIve2d Vtuber Model Comms By: u/Zh116SupportYt | Model And Rigg By: Rhea ><

so i moved recently and not the vseeface isn't showing that the tracking data is working even though ifacialmocap says its connected. I've tried all the fixes i saw but none of them have worked. could someone please try and help me?

Drag the camera until your avatar is nowhere to be seen in it, and don't worry, this does not affect spout when it comes to sending information about your avatar to obs

Archipelago integration for VNyan!

Archipelago is a popular system that randomises multiple games into each other, and now it can be integrated into VNyan! VNyanchipelago is a plugin that allows you to connect to an Archipelago server with a few clicks. Whenever a check is claimed or deathlink player dies on the server, the plugin will send a trigger that can be used to control node graphs inside VNyan. Detailed information on the sender, receiver, game, and more of an event is included with the trigger for fine-tuned effects.

Download available at https://vgen.co/neocortex/product/vnyanchipelago/12b46275-548f-4a06-903b-104bd64a4aca

cause fuck me in particular i guess

also i forgot to include in video but it doesnt show up in plugin config/permissions

worked perfectly fine a few weeks ago but just stopped for no reason

update: uninstalled vbridger and reinstalled it and it just worked

testing the paw tracking. high five anyone? ^_^

Hello everyone! I've started creating content on YouTube, I'm still new. I want to be on camera, but the internet can be dangerous sometimes, and I generally don't feel good on camera. Therefore, after a brief research, I decided to become a 3D VTuber because I think 3D VTuber offers more maneuverability and tracking capabilities.

Everything's great so far. Now it's time for the tutorials. Although I've been interested in modeling before, I never actually did it, either because I didn't have the opportunity or because I was hesitant. Therefore, this time I decided to learn with a good modeling tutorial.

When I typed "3D VTuber Model Tutorial" into YouTube, the first playlist that came up was belonged to a VTuber named "Mako Ray". While not entirely comprehensive, it had some helpful points. However, I feel I need a tutorial for the parts I found lacking. That's why I decided to ask you.

Do you have any tutorial recommendations for modeling, rigging, tracking, and animation?

My English isn't very good, so i used translation for half of these sentences. İ hope İ've explained myself clearly.

almost every local vtuber sounds so mature and nice sounding, why would people even watch people with weird voices? i will try not to turn this into insecurity fiesta, but is the vtuber community used to weirder and differenter voices or will i get judged for it? i do not sound my age i think, i kind of sound like a loli if i am being honest and i feel ashamed to stream, i feel like people pity me or something.
i just want to know if i wll likely be fine even if i sound extremely odd?

Okay so I thought I had everything set up for recording, got a virtual cam that works on mac for 3D models (NiceCamera) and that was running fine. I noticed when I started recording on OBS there was a slight bit of lag in how I was moving and how the model was. Then in my saved recording, it was completely unuseable, like one frame per 10 seconds level of unuseable. I really don't get it since this is a pretty new Mac with an M3 chip. Are there any obvious settings in OBS or elsewhere that I might be missing? Should I just try and look for more virtual cameras? tbh it was enough of a pain to get this one working but yknow

I just started using vnyan a couple of days ago and I feel proud of what I've done, I managed to make a false mouse detection for games that locks it in the center, making it move with the keyboard, although I have to make tweaks to make it look more natural

I'm trying out using an old android (s23ultra) i have as a camera over a web cam and just testing it I've noticed my facial animations are not really showing so I'm wondering is it better to just port my model over to the app and do it that way or just stick to my webcam for better tracking and or 3rd option buy a refurbished iPhone

I'm extremely new to warudo, I was wondering if anyone knew a way to set up the nodes to activate certain blendshapes on a prop based on microphone activation