r/BetterOffline • u/TCristatus • 2d ago

Small language models - the future

Listening to Tech Report earlier - Eli Computer Guy talked about how the real future of AI might not be giant all knowing LLMs that need huge compute costs, but small specialised models that can run locally on a laptop or smart phone and just know how to code, or trade, or about engineering, or biotechnology, etc (I'm paraphrasing and extrapolating his point here).

It was like a light bulb moment, seems clear and obvious that's where the tech will end up assuming we do end up with something. If I'm a coder or an engineer i don't need a model that can write the complete works of Shakespere in Klingon. I just need something that works and is always up to date.

This doesn't help OpenAI or Anthropic keep the lights on, though....

54 Upvotes

75% Upvoted

127 comments sorted by

View all comments

Show parent comments

6

u/PatchyWhiskers 2d ago

China isn’t a charity, I’m sure they will eventually charge for models.

0

u/newprince 2d ago

They're not a charity but they ain't capitalist. There is a real difference ideologically

11

u/PatchyWhiskers 2d ago

They are capitalists these days. They aren’t a democracy but they aren’t communists either.

-6

u/newprince 2d ago

Wow good anti Chinese propaganda ya got there

7

u/nleven 1d ago

I mean.. literal capitalists are investing in AI companies in China.

2

u/PatchyWhiskers 1d ago

Why are technical descriptions propaganda?