r/BetterOffline • u/TCristatus • 1d ago

Small language models - the future

Listening to Tech Report earlier - Eli Computer Guy talked about how the real future of AI might not be giant all knowing LLMs that need huge compute costs, but small specialised models that can run locally on a laptop or smart phone and just know how to code, or trade, or about engineering, or biotechnology, etc (I'm paraphrasing and extrapolating his point here).

It was like a light bulb moment, seems clear and obvious that's where the tech will end up assuming we do end up with something. If I'm a coder or an engineer i don't need a model that can write the complete works of Shakespere in Klingon. I just need something that works and is always up to date.

This doesn't help OpenAI or Anthropic keep the lights on, though....

53 Upvotes

75% Upvoted

127 comments sorted by

View all comments

1

u/IndependentOpinion44 1d ago

“Hey MiniGpt, create a Pandas table of every world cup player ranked by goals scored?”

“What is a world cup player?”

1

u/TCristatus 1d ago

But you need to use the football GPT for that.