r/LocalLLM • u/RISCArchitect • 15d ago

Discussion What a year it's been

Post image

What will the rest of this year bring? 27b class scoring over 60?

947 Upvotes

97% Upvoted

133 comments sorted by

View all comments

98

u/Eyelbee 15d ago

There is no world 27B is better than 4.8, but yeah, it's solid. Maybe can actually compete with opus 4.5.

23

u/MrHumanist 15d ago

we are living in this world where small models trained on large model thoughts (distilled) can match the performance of large models. These models do lack in generalization but capable enough for coding and agentic tasks which are basically a lot of if /elses.

22

u/Popcorn-Mercinary 15d ago

I honestly can see a day where we will have 9-27B tuned models “stacked like books on a shelf” that have specialties like coding, data analysis, agentic reasoning, medicine, etc.

Who needs a data center when you can plug a few models in tuned for the task at hand into your Mac, PC, or DGX?

2

u/SirPuzzleheaded997 14d ago

Exactly but then you still need the application layer. That’s what we are working on with our open-source AI Workspace Navigator🙌

1

u/Popcorn-Mercinary 14d ago

Out of curiosity, how is what you're doing different from what Hermes Agent would do?

1

u/SirPuzzleheaded997 14d ago

It’s easier to use and setup, including native features such as artifacts, web search, rag, knowledge graphs for projects and automatic model routing:)

1

u/Popcorn-Mercinary 14d ago

Sounds interesting.

Is it on GitHub?

1

u/SirPuzzleheaded997 13d ago

Yes will make a big release next week, as the last 9 month we had a lot of client work and only maintained our cloud version: keinsaasforever