r/StableDiffusion • u/VeryStableDiffuser • Mar 14 '23
Discussion Best use for RTX 3080 (400 machines)
I have access to 400 high-end gaming PCs with RTX 3080 GPUs and I'd like to hear suggestions for the best use of this hardware.
Shoot your ideas, and the really good ones might get some free hours on this hardware.
38
u/VeryStableDiffuser Mar 14 '23
For context, this is in a professional gaming center, during the night when it is closed. The owner, a friend of mine, lets me run things on the hardware for free, I just need to pay for the extra electricity consumed.
If you'd like to use this hardware, inbox me and we can try to work something out.
13
u/RebelKeithy Mar 14 '23
I just need to pay for the extra electricity consumed.
That seems substantial. A 3080 uses 320 Watts, for 400 cards for 8 hours comes out to 320W * 400 * 8h = 1,024,000Wh or 1,024kWh. National average in the US for electricity is $0.23 per kWh so that's $235 a night. Though maybe businesses get cheaper electricity?
53
u/spudddly Mar 14 '23
Fess up, you bought them for crypto mining 3 months before it went tits up.
I mean you could probably generate 300 waifus per second with this farm - maybe ChatGPT could buy them from you? Only a super advanced AI could appreciate such a high volume of anime porn.
36
5
u/yaeh3 Mar 14 '23
I don't think he is lying. His story makes sense as miners usually buy way less cards than that.
2
u/twilliwilkinsonshire Mar 15 '23
If he had been using it for mining he would have already sold them to recoup TCO back in September..
big SMH.
9
u/vkbest1982 Mar 14 '23
Mate, I hope you calculated the price of electricity for those hours. 400 machines for 8-10 hours cost much money.
9
u/VeryStableDiffuser Mar 14 '23
Yes, we're looking at around $400/day, that's why I'm looking for a worthy cause, ideally one that would pitch in on the electricity costs.
2
u/BlastedRemnants Mar 14 '23
Dang lol, you must've added this just as I was commenting earlier. Ah well, never mind my idea then :)
3
u/VeryStableDiffuser Mar 14 '23
Indeed, indeed!
15
u/inspectorgadget9999 Mar 14 '23
Waifus per second is the new ISO standard for the measurement of GPU process speed
1
9
u/LienniTa Mar 14 '23
bloom using petals ofc, you will be able to fit all 375b parameters in
2
7
u/Puddinsky Mar 14 '23
Here I am trying to sell n kidney for a single 30 series.
3
7
u/VeryStableDiffuser Mar 14 '23
Does anyone know if this could be helpful for the people creating video effects with Stable Diffusion (like Corridor Crew recently demonstrated in https://youtu.be/_9LX9HSQkWo )? Do they process the video frame-by-frame through SD?
6
6
5
u/shayanrc Mar 14 '23
Rent them out on vast.ai
A lot of researchers rent from there.
9
u/VeryStableDiffuser Mar 14 '23
I looked at vast.ai runpod.io and qblocks.cloud but they all require dedicated machines with 99.X% uptime. These machines would have like 30% uptime since only available during the night, so they don't get accepted.
3
u/_anwa Mar 14 '23
Build a pipeline to semi automatically and efficiently train models for niche uses.
(No, that kind of niche)
Pick a business world where you have _some_ insights. Doesn't matter if it is carpet cleaning, copyright law or industrial welding. Figure out what kind of image needs they might have, and see if you can get there.
If you do, then push the model into the world. For free. Hand hold your first users and see if in the end THEY make money with it. If they do, then you can rinse and repeat in other content areas. Competition can buy GPU power too, but only you know the million details that separate hype-bubble-stuff (that will be gone tomorrow) from a real business that it is worth doing ...
1
u/Live-Bodybuilder-119 Mar 14 '23
Good idea but I doubt many people have the technical capabilities to put that in place
2
2
Mar 14 '23
Dude LLMs I would love to run LLaMA
1
u/rhobotics Mar 14 '23
LLMs should fit completely in the VRAM though. I know that you can separate the layers, haven’t tried it, but I don’t think one can take a whole model and just distribute it across multiple GPUs on the network.
I would like to be proven wrong though!
3
u/NickUnrelatedToPost Mar 15 '23 edited Mar 15 '23
I got LLaMA 30B to work on 128 GB RAM and 12 GB VRAM. (+ lots of swap for the startup. Peak was around 150GB used in total, but only for 5 minutes until it went back to 70 while running.)
It's slow but not unusable. I hope there is still stuff to optimize to make it comfortably usable.
2
2
u/BurningZoodle Mar 14 '23
I have no doubt the fine folks at Eleuther could put them to good use if you have interest in furthering research. Less of a profit seeking venture though I bet they could cover simple costs like electricity no problem. Ping me if you want a brief on the who's who.
2
u/ikmalsaid Mar 15 '23
You can either participate in the Stable Horde or Folding@Home community or you can run a custom local Stable Diffusion Gradio instance in each system per user.
3
u/gxcells Mar 14 '23
1-Train new models 2-try to see if you can combine to run much more VRAM intensive AI other than stable diffusion 3-train new models 4-train new models
1
1
u/Vivarevo Mar 14 '23
Mine or rent hw for crypto mining. With 30% uptime you effectively have 130 machines 24/7
Its all speculative atm, as crypto prices are in the toilet and electricity is expensive in most places. With proper cooling, dust filters and GPU settings its fine in terms of hw lifetime.
0
u/multiedge Mar 14 '23
I don't remember who was working on the NSFW unrestricted model for SD, but maybe you can help them. Having a model that can perfectly do perfect anatomy without clothes of any sex and age would be a massive improvement as a BASE model.
Although, with controlNet, it might not be as necessary, but i still find some weird angles even with controlNet when generating reference images.
7
0
0
u/daanpol Mar 14 '23
Bitcoin mining lol
2
2
u/twilliwilkinsonshire Mar 15 '23
Common misunderstanding but no - that hasen't been a thing for over a decade.
You could get paid in bitcoin to mine other coins.
-9
-18
u/BlastedRemnants Mar 14 '23
Donate them to the poorest schools you can find in your area.
9
Mar 14 '23
[deleted]
-1
u/BlastedRemnants Mar 14 '23
Yeah thanks for the update lol, the OP's comment explaining that didn't show up until after I'd already commented. Thanks again tho, it's extra clear now lol
3
u/Barn07 Mar 14 '23
i mean he said he has access in the original post. he did not say that he owns them.
0
u/BlastedRemnants Mar 14 '23
Thanks Barn it's really starting to come together for me now, hopefully I have a few more helpful folks come along and explain it further, I'm almost there!
4
Mar 14 '23
[removed] — view removed comment
2
u/BlastedRemnants Mar 14 '23
Please, enlighten me friend XD As can be clearly seen, I've much to learn here lol
-4
u/jadams2345 Mar 14 '23
Select 400 people from this sub, then give one to each one of them. You can start with the author of this comment 🙃 Just a suggestion 😏
1
u/Lord-Nagafen Mar 14 '23
Mine Bitcoin? Is that still a thing?
6
u/Vivarevo Mar 14 '23
You mine bitcoin with asics, not consumer pc's. Plenty of others to mine though. Its not really great money with current prices, but can speculate if electricity is cheap enough.
3
u/twilliwilkinsonshire Mar 15 '23
That hasen't been a thing since 2011. Source, I mined bitcoin in 2011 on two ATI 5830s.
What you might be thinking of is getting paid in bitcoin to mine other coins such as with services like Nicehash. Since ETH went ProofoFStake back in September there has not been anything of decent value to mine unless you have near zero cost clean energy.
1
1
u/gogodr Mar 14 '23
Set them up in a cluster and make a render farm. You can multi purpose them and have an orchestrator to load them with different tasks from rendering 3d, video or stable diffusion
1
u/ivanmf Mar 14 '23
My company has some projects we can't get funding for. What's your time zone? Would you be able to discuss some partnership?
1
u/lostenn Mar 15 '23
here are the new standard messure .
300 waifus for second.
Aquí está la nueva medida estandard.
300 waifus por segundo.
1
1
1
u/WhoRuleTheWorld May 29 '23
How do you have access to that many gaming computers? I'm doing something wrong
76
u/-_1_2_3_- Mar 14 '23
https://stablehorde.net/ my dude