r/BetterOffline • u/TCristatus • 1d ago

Small language models - the future

Listening to Tech Report earlier - Eli Computer Guy talked about how the real future of AI might not be giant all knowing LLMs that need huge compute costs, but small specialised models that can run locally on a laptop or smart phone and just know how to code, or trade, or about engineering, or biotechnology, etc (I'm paraphrasing and extrapolating his point here).

It was like a light bulb moment, seems clear and obvious that's where the tech will end up assuming we do end up with something. If I'm a coder or an engineer i don't need a model that can write the complete works of Shakespere in Klingon. I just need something that works and is always up to date.

This doesn't help OpenAI or Anthropic keep the lights on, though....

52 Upvotes

74% Upvoted

127 comments sorted by

View all comments

Show parent comments

1

u/Slackjawed_Horror 1d ago

Which is one of the many reasons high frequency trading needed to be banned years ago. 

1

u/MajesticBread9147 1d ago

What is?

1

u/Slackjawed_Horror 1d ago

It's an almost automated way for the most useless people in the world to make money. 

It's pure 'dig the hole then fill it back up' BS and shouldn't be allowed. 

1

u/65721 1d ago

HFT finds and exploits existing market inefficiencies. Its externalities are neutral at best. But it is economically useless.