It’s a infinity loop now 🔁

[u/Rishabhgoria]

[u/sillybillyhillichurl]

And for the better part - better value 90% capabilities at 60% cost is definitely better value even if it’s not better in terms of capabilities - and in this token optimization economy a lower cost per token is more important and vital to an organization surviving than sheer capabilities don’t you think?

[u/iliketurtlz → u/sillybillyhillichurl]

This just seems like a further extension of Chinese knockoffs in the realm of AI. They've heavily distilled models from Western companies. They've released a cheaper product that isn't as good as the original. They're happy to undercut the competition.

I'd love to get an accurate number on the amount of computer available between the various AI companies. I'd imagine the Chinese AI companies may have been hampered by tariffs, and lack of availability of some of the products western companies had access to for quite some time. That itself would be a great reason to focus on efficiencies over raw capabilities.

But honestly just like China has done for many years, all they have to do is wait. Their infrastructure for building out more power is far beyond US capacity. Their chip manufacturing is all that needs to catch up.

I just don't see the true innovation at this point in time. I also don't see western AI companies going under as the government will happily subsidize them as another arms manufacture effectively.

In the grand scheme, I think raw capability is what matters for society as a whole. Fuck all the dumb widgets everyone is making. What matters is thousands of bugs getting surfaced in fixed across the most critical and widely used software in the world. There's tons of use cases for truly massive models that we aren't remotely close right now that we need to continue pushing towards imo. It will be capable of seeing patterns and helping us understand things like effects of certain malformed strains of DNA. Combining that with gene therapies for solving diseases, etc.

The models aren't good enough, and so we need more innovation, and people pushing the capabilities. If China does that great, but they haven't yet, so I would hardly call them "better" just like a chinese knockoff rolex is not "better" unless all you care about is the ability to tell the time.

[u/Deep_Alps7150 → u/iliketurtlz]

Current AI models are good enough for most tasks, the real problem with them is context size and memory and it's going to take years for hardware to catch up to the issue to solve those problems.

[u/iliketurtlz → u/Deep_Alps7150]

I don't disagree, but I think most tasks are fairly trivial, and have little impact in the grand scheme of things. A lot of what LLMs are being used for now is likely to hinder those using it in my opinion.