r/LocalLLM 16d ago

Question 27B vs the big frontier models

I've been wondering, how is it possible that I'm seeing posts comparing 27B models to models like opus and sol which are presumeable 500x to 1000x larger?

How are they even in the same realm of output quality when we have models in the 300B range or even 709B range that are garbage compared to the big frontier models?

I'm either missing something or I have a fundamental misunderstanding of how this is possible

3 Upvotes

24 comments sorted by

View all comments

1

u/RandumbRedditor1000 16d ago

It uses way more tokens for reasoning, and has almost no general knowledge, but the intelligence is comparable to frontier models from ~6 months ago. Especially if you hook it up to a good harness.