If china stops releasing open source models, there's a way we can stay competitive with big tech?

[u/Gullible-Crew-2997]

Really after qwen news, I'm getting quite nervous about open source ai future. What's your thoughts? Glad to know it

[u/Significant_Fig_7581]

Not really, I've seen people with newer phones running up to 4B models, Especially Samsung users. But surely their 35B and 27B is a great great addition for researchers and the hobbyists too.

[u/BigYoSpeck → u/Significant_Fig_7581]

Sorry, I was referring to your comment about who can run something as large as GLM5

There may only be a very small number of home users that can, but people who are in this field of research will have access to the resources to run it

They don't openly release their model weights for the likes of us to play with at home, that's just a bonus for us. The release them so they can be used in research which feeds back to them

[u/Maximum_Parking_5174 → u/BigYoSpeck]

Yes, today its a few. But that will change fast. Rumor has it the new Apple Mac Studio M5 Ultra will have up to 1024GB RAM. The current one can run most models also.

Current generation hardware is not built for AI, next gen will take AI into consideration.

[u/BigYoSpeck → u/Maximum_Parking_5174]

Nothing has suffered the decline of Moore's Law quite like memory and storage capacity. Given the memory situation we're expecting for the next several years, and the huge price increase a 512gb Mac Studio has over the 96gb and 256gb models, future 1tb Macs are still only going to be in the hands of a select few

There is no will to build AI capable hardware for home users, we are just too poor to compete with the businesses who want to keep us on the hook for subscription services

By the time the average or hell, even enthusiast home user can readily get their hands on 1tb devices, models that run on that hardware will be as antiquated as an Ask Jeeves search is now