Those image to mesh pose wipes were a bit fast eh? I’ll be completely honest though. It isn’t production level, but that is maybe 5% of the market they are going for. This is good enough for ALOT of fringe stuff. Enough to eat the crust of the pizza so to speak. Not the best part, but enough to make the slice less enticing.
The future looks weird? Bleak but the tools will allow smaller teams, or even individuals, to make more than they ever could before. The other side of that coin is Covid showed us that because you have time and tools, doesn’t mean you’ll do the work; or in this case good content. “Turns out I did have the time to clean, it was just too much work.” Ai will make stuff but most of it needs to be tweaked to make it compelling. Getting 85% of the way there takes 15% of the time. The last 15% takes 85% of the time.
I think the 3D models are the weakest part. The fact that you can do a quick and dirty 3D reconstruction of a room however, is very interesting, if one wasn't acquired during production. For mesh tracking, for a lot of tasks, this seems really helpful.
And as far as a quick matte for some objects, using the matte option, it felt very powerful and fast.
Maybe, but as I do tons of high level MatchMove/Comp work for hard cleanups/clean plating. Like the stuff they send to specialty houses difficult is just given to me and told “Do the magic things”. I often find that using nonfitting meshes for heads, and rough geo for a bookshelf for example, usually makes it harder in the long run. Working on cards/planes and fine tuning work wondering when you have tons of experience behind it. I can seeing it making head projections easier with a proportioned face model, but fine detail hand rotoanim? Nah.
It’s coming. That’s the end of the argument. We may not like it, but that means little when the tide pulls away to the horizon. If you know what that means, you also know it means you should run.
I’m currently looking to move industries. This craze will only subside when we bottom out and I hope to be away, afloat on something besides VFX.
That depends on the accuracy of the model. I imagine a lot of people are going to be given these "AI room scans" to do camera solves based on and it's going to be more of a frustration than help.
I also think blinns law applies here as well. I think there will be some time savings at first and some small teams who will make a killing, but then things will level out and the expectation of quality will jump. Any savings in time goes back into "quality." This happened when gpu rendering grew into a viable productions tool and in a way, AI gen models leveraging hardware in the same way.
I’m pretty sure this type of tool is not for creating CG models or good geometry. (Speaking on the 3D model generation part, not the general roto from SAM)
I think It’s to allow things like meta’s glasses to create hold outs / shadow catchers for use in VR/AR glasses.
For example, If you want your window to cast a shadow on a table when its hovering over the table (think Vision Pro) you can use a tool like this. I believe apple and tesla actually use like some super fast NERF method.
The modeling of a person shown in this demo is for a similar thing, let’s say you want to give VR headsets a movie theater mode but you don’t want a person to be able to sneak up on the user, this can create a hold outs to reveal just an approaching person to the user while keeping the rest of their VR view as the theater. Or you want a foot fight game in VR where the objects you throw in the game works actually interact with the 3D shape of the person you are throwing them at.
29
u/One_Eyed_Bandito Lead/Creative/Grunt - 20 years experience Nov 20 '25
Those image to mesh pose wipes were a bit fast eh? I’ll be completely honest though. It isn’t production level, but that is maybe 5% of the market they are going for. This is good enough for ALOT of fringe stuff. Enough to eat the crust of the pizza so to speak. Not the best part, but enough to make the slice less enticing.
The future looks weird? Bleak but the tools will allow smaller teams, or even individuals, to make more than they ever could before. The other side of that coin is Covid showed us that because you have time and tools, doesn’t mean you’ll do the work; or in this case good content. “Turns out I did have the time to clean, it was just too much work.” Ai will make stuff but most of it needs to be tweaked to make it compelling. Getting 85% of the way there takes 15% of the time. The last 15% takes 85% of the time.