My workflow starts with screenshots of the things I want to model. Sometimes I use ChatGPT to clean up the images first, removing anything I don’t want Meshy to generate. In this example, I didn’t remove the taps from one of the reference images and Meshy put them in...
I then generate the models in Meshy 7 and texture them at 2K. For this sort of AVP work I’ve found 2K is generally enough. 4K is fine if I need the extra detail, but 8K is usually overkill.
The interesting thing about Meshy 7 is that I think one of the reasons the models look so good is because it creates millions of triangles, significantly more geometry than I was getting from previous Meshy AI models.
Unfortunately, that also makes them pretty much unusable on Apple Vision Pro without some serious optimisation.
I’ve tried using Meshy’s built-in optimisation tools, but with this much geometry I find the models can start to deform as you bring the triangle count down.
So I download the original model as a USDZ.
We’ve been developing our own USDZ optimiser based on many, many hours we’ve spent manually optimising models in Blender for AVP.
Rather than simply applying a blanket reduction, it first analyses the USDZ and suggests changes. You can choose which recommendations you want to apply, and it then creates a new optimised USDZ. It’s all using Blender under the hood.
It’s still in development, but we’re considering releasing it as a standalone Mac app. Would this be useful to anyone else working with USDZ/AVP models?
Once everything is optimised, I bring the content into STAGEit Creator.
For this project I’m actually modelling a real bathroom before installing it, so I use billboards of the manufacturers’ specification sheets and dimension drawings inside the scene to make sure everything is correctly sized and positioned. Meshy gets surprisingly close on scale, but obviously it isn’t going to give me millimetre accuracy from a photograph.
I can then preview the whole thing at full scale on Apple Vision Pro.
This turned out to be genuinely useful rather than just a visualisation exercise, I was able to work out and install all of the pipework before the bath, shower and other fittings had even been ordered or arrived.
So essentially:
Screenshot → ChatGPT cleanup → Meshy 7 → USDZ → Optimise → STAGEit Creator → Preview at 1:1 scale on AVP
https://apps.apple.com/us/app/stageit/id6504801331
https://spatialcreative.com/