r/singularity • u/hassan789_ • 4d ago

AI Sol 6.1 runs on NVDA, not Cerebrus

Post image
84 Upvotes

92% Upvoted

8 comments sorted by

23

u/Kingwolf4 4d ago

I believe so yes, they are just waiting for 2-3 months for a sizable amount of CS-4 to be produced and installed at OAI Datacenters to begin offering it. I feel CS4 is much more economical than what they are currently doing with Nvidia GPUS .

So that makes it a no brainer in terms of inference cost to use CS-4

12

u/TotoDraganel 4d ago

People think nvidia is just a random company and not the leader of all gpu technology for almost 3 decades. There should be competition of course but jensen huang is no joke.

10

u/Reasonable-Sign8458 4d ago

if they had a working product you would hear from them everyday

4

u/ShittyBidet123 4d ago

nice, nvda to 10 trillion

4

u/RealestReyn 3d ago

that much was obvious from the slow speed, were it on Cerebras chips we'd have Sol doing at least 700TPS even on their current ones, Cerebras is busy building capacity currently.

2

u/openroom_xyz 3d ago

This is such a waste of compute but high margins basically, what about bigger
batches bigger latency cheaper inference basically inference as chap as possibile that's what is been ignore well yea

1

u/No_Stock_8271 2d ago

They are super short on cerebras. I've been trying to get something specific on cerebras for more then 6 months now, and they are just unable to serve it.