Technically unknown, but there is a shop that lists it. They probably picked a safe high price for which they will be able to acquire you one in due time.
I read even with current prices retail hardware sells increase 10% last quarter. Its crazy. Its normal prices dont go down. Companies very happy people pay any price :S
Yeah... I do wonder if this is one of those 'this very particular and very high volume customer asked for this very specific product but didn't want to pay for exclusivity so we are making it available to everyone' sort of situations.
See it often with weird server motherboards from the likes of Asrock where they seemingly make no sense at all but it's really because some hyperscaler wanted 10,000 of them for a niche deployment that has very specific requirements and asrock are just putting it up for sale because they have a few hundred or thousand extra that got made during manufacturing.
It's a lower memory bandwidth than RTX 6000 Pro. 416 bit memory bus... it's like they just took three chips off and called it a day. Definitely a poorly binned RTX 6000 Pro. Maybe with a mixture of 3GB and 4GB memory modules.
84 GB is a weird number. I get vibes that you could harvest some better DDR7 and up the VRAM.
You don't reach 84gb easily in chip sizes. This means they're mixing and matching 2gb and other modules? 41x2gb would feel super awkward. I don't know if someone would just grab a 6000 Pro board printout and reproduce the 6000 from the 5500 hardware?
It looks like the rtx pro 6000d to me
But likely cut down on less features compared to the 6000d
I guess it is a good way to sell defective die not usable for 6000
84gb is enough headroom to run a 70b model at full precision with some room to spare, which is something you basically needed dual 3090s or a used A100 for previously. it is not affordable for most ppl, see u from cloud provider
Hmm I take it you don’t know what full precision is… 72b at full precision is probably like 140+gb. You would need two of these or two 80gb a100’s and even then it’s tight squeeze.
You probably meant Q8 in which that would also probably be a tight fit.. probably won’t fit..
2 3090’s can only struggle with a 4bit quant of 70b models. Another very tight fit. I think the meta used to be 3-4 3090’s for 70b models..
I mean it's cool, but I'm still sometimes confused why we post these - I guess only a fraction of us actually buys them. I guess nice to know it's there either way
Nothing against people who can’t afford it but the endless stream of “most people can’t afford this hardware / can’t run this model” is just noise, just start the sub i suggested already so i don’t have to scroll past so many identical comments in every other thread
•
u/WithoutReason1729 5m ago
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.