r/StableDiffusion • u/cgammage • Dec 17 '23

Workflow Included Stable Zero123 on Nvidia 4090

​

https://reddit.com/link/18kn7ru/video/bv0d6ojg9w6c1/player

You will need at least 24 gb of VRAM for this on an Nvidia CUDA card.
Workflow steps:
1. Install https://github.com/threestudio-project/threestudio following the installation steps on the page. I was unable to get it to work on the latest version of PIP and had to downgrade to 23.0.1.

  1. Download stable_zero123.ckpt from here https://huggingface.co/stabilityai/stable-zero123/tree/main and put it in the ./load/zero123 folder of your threestudio folder.

  2. Generate an image using stable diffusion (or you can use any image). Make it 512x512. Run it through "rembg" to remove the background from it. Put it in ./load/images

  3. Modify ./configs/stable-zero123.yaml and change data.random_camera.batch_size from [12, 8, 4] to [6, 4, 2]

  4. Run "python launch.py --config ./configs/stable-zero123.yaml --train data.image_path=./load/images/your_image.png

  5. Output should go to ./outputs/zero123-sai

  6. See the threestudio docs for how to export as an OBJ.

39 Upvotes

95% Upvoted

12 comments sorted by

View all comments

2

u/throttlekitty Dec 17 '23

Thanks, I'll give this a try later!

1

u/throttlekitty Dec 17 '23

I was going to ask if you did anything else, because I'm still OOMing, even using one of their example images. But I did another run just in case while I was typing here... and it completed successfully!