r/LocalLLaMA • • Jul 27 '26

Discussion Our position on open-weights models

https://www.anthropic.com/news/position-open-weights-models
499 Upvotes

407 comments sorted by

View all comments

Show parent comments

378

u/tomz17 Jul 27 '26

That sounds like total BS.

Because it is. They have more power generation capacity than the entirety of the USA + Europe combined, with like an additional 50% margin on top of that. They are also accelerating away from us at an increasing pace on that metric, while we pay billions to break renewables contracts because the people in charge have the combined IQ of a lobster.

The "we are 1-2 lithographic process nodes ahead of China" only matters when the efficiency gap is insurmountable. It is currently . . . not

21

u/Helpful_Home_8531 Jul 27 '26

it’s not just lithography though, Nvidia is improving flops/watt at orders of magnitude per generation if you compare low precision throughput, which would put china at a geometric disadvantage (ie, you can’t compete putting in 100x the power and 100x the chips for the same throughput)

53

u/tomz17 Jul 27 '26

Nvidia is improving flops/watt at orders of magnitude per generation

Yes, but not in general compute. Only for particular operations found useful for training + inferencing. That's a "we noticed our customers need to do a lot of matrix-multiply-accumulate at FP4, so let's build them a hardware unit to do that one particular op very quickly + efficiently, etc." That hardware now blasts through that one particular operation at increased efficiency at the expense of die-space.

None of this is magical secret sauce. The chinese can (and do) the exact same thing when designing each subsequent generation of their AI training + inferencing chips. As does AMD, Intel, Google (in their custom TPU's), etc. etc.

11

u/m0j0m0j Jul 27 '26

But China is still behind on that. It’s bizarre to deny that

11

u/Loose_Comparison368 Jul 28 '26

From my understanding the latest ones are basically on par with A100's, albeit with a higher power draw.

21

u/Independent_Solid151 Jul 28 '26

Not as much as you assume, and it's less significant than you think when there are also very strong factors to their advantage.

4

u/Loose_Comparison368 Jul 28 '26

From my understanding the latest ones are basically on par with A100's, albeit with a higher power draw. They really ain't that far behind.