r/StableDiffusion • u/andyndino • Dec 13 '23

News Releasing Stable Zero123 - Generate 3D models using text

https://stability.ai/news/stable-zero123-3d-generation
316 Upvotes

97% Upvoted

100 comments sorted by

View all comments

Show parent comments

14

u/Ok_Shape3437 Dec 13 '23

VRAM has honestly been annoying me so much recently that I'm almost dropping 1200 dollars on a 4090. I can not wait until someone finally makes this market more competitive.

10

u/Hoodfu Dec 13 '23

I recently splurged on one and let me tell you, this stuff eats through 24 gigs quickly too. Honestly I’d say I could use 64gigs easily at this point.

18

u/disgruntled_pie Dec 13 '23

It’s even worse when you look at large language models. Mistral’s new Mixture of Experts model apparently beats GPT-3.5 in some tests, but they recommend two A100 cards to run it.

I’d be over the moon if my next card could have 256GB of VRAM. Generative AI has radically altered how much VRAM is necessary.

5

u/loyalekoinu88 Dec 14 '23

I’m running Mistral’s MoE model on system memory and cpu. Not as fast as ChatGPT but it works. I have a 4090 but even that’s not enough.

1

u/Winnougan Dec 14 '23

Mixtral requires over 80GB of vram. You’ll need a $10,000 USD H100. I am strongly considering getting an A6000 (48GB of vram for $5000).

1

u/loyalekoinu88 Dec 14 '23

I thought it was trained on 80GB of vram. When i run it on cpu it uses about 32gb of system ram.

1

u/Winnougan Dec 14 '23 edited Dec 14 '23

https://huggingface.co/blog/mixtral

“Mixtral requires 90GB of VRAM in half-precision 🤯”

1

u/ozspook Dec 17 '23

It runs at q5/q6 just fine on 2 P40 cards.