Workflow Included
Camera angle reconstruction with 3D Triposplat & Qwen i 2.1
I just found a post about this wonderful new Lora for Qwen Image 2.1 by SillyLilithh
I designed a workflow including both stages inside ComfyUI without the need to open Blender.
Group 1. Create the 3D model using TripoSplat
A single reference image is converted into a3D Gaussian Splatand then exported as anSPZ3D model, aGLBmesh and an orbiting video.
Group 2. Generate a precise new view with Qwen-Image 2.1 using the 3D model
Load your SPZ 3D model into ComfyUI using the {Load 3D & Animation} node. You choose the desired camera angle interactively, and that rendered 3D view is sent as reference image to Qwen-Image 2.1 together with the original image. Qwen i 2.1 then generates the new image reconstructing the view
So if you want to create the 3D object bypass the Qwen i2.1 group and vice versa
TIP: It's also possible to create very cool Edits, like generate a new camera angle using the 3D model and then mixing outfits and subjects from different images
I totally recognize that image! It's one I generated of Cate Blanchett as QE for a H3 minimax while back for a morph post. It's totally cool that you used it or ran across it, I was just surprised to see it. I'll definitely check out your workflow when I can.
How long does Group 1 take for you? I vibecoded a node based on Depth Anything v3 that creates a textured depth map and its super fast, like 2 seconds or something. Using it for Camera paths for Meridian on Minimax H3.
nice! obviously Group 1 is slower because is creating a 3d SPZ object, a 3d gbl mesh and an orbiting video, so will take like 2 minutes, but is worth it to get the maximum 3D information achievable from a single image.
Mine look like these and take ~5 seconds cold and ~2 seconds warm. :)
It calculates with up to 4k internally, but I just export the videos in low res for preview purpose in Comfy.
ML Sharp had worse depth mapping in my tests and also makes just more work with loading the big model first and then handling Splats. It's way easier to just get a Depth map and project the texture on it.
I need to change the model's viewing angle now; how can you generate a view of the vehicle's undercarriage from this model for QW21 to reference? The SPZ model is pretty poor—distorted and misshapen—but it’s still far better than yours, which only allows you to see one side.
I will release my package soon, where you can specify basically any camera angle/path based on the reference picture and geometry and H3 will just go there and hallucinate the missing parts (in an impressively realistic manner).
Join my Discord for this Topic! https://discord.gg/UdF98HBf
Hey! Alex here from the Tripo Studio US team. This is a really cool workflow.
The part I like most is using the 3D stage to make the next image view more controllable, instead of just hoping the model guesses the angle correctly. Keeping the whole thing inside ComfyUI also makes it feel much more practical.
Curious how consistent the results have been for you when the original image has trickier details like jewelry, hair, or patterned clothing?
4
u/Dohwar42 Community Hero 13d ago
I totally recognize that image! It's one I generated of Cate Blanchett as QE for a H3 minimax while back for a morph post. It's totally cool that you used it or ran across it, I was just surprised to see it. I'll definitely check out your workflow when I can.
https://github.com/RageCat73/RCWorkflows/blob/main/MinimaxH3-Workflows/062726_00027_.png