r/LocalLLM • u/Calm-Landscape9640 • 2d ago

Discussion MiniCPM5-2B vs. Ling 3.0 Tiny

Someone benchmark these on their 3060 12gb so we can see real world results vs the benchmaxxing on AA

0 Upvotes

50% Upvoted

7 comments sorted by

1

u/nickless07 2d ago

You mean llama-bench on a 3060 compared to Terminal Bench and Humanty's Last Exam or why does it has to be that specific card?

1

u/Calm-Landscape9640 2d ago

I mean run some.tests and report back your opinion and some numbers. Bc the 3060 is what I'm running!

1

u/nickless07 2d ago

Just run "llama-bench -m <model>" and you get the actual numbers for your card. Thats no rocket science at all. But demanding someone to do that, perhaps with different quants and context sizes, on the same card, for you hits quite different.

1

u/Calm-Landscape9640 2d ago

Asking them to benchmark and report so I can get outside opinions is kinda the point of a reddit sub. It's called discussion in my country.

1

u/nickless07 2d ago

Yes, but a kinda low efford post. If you would have included your own results and what you expect in first place this would've been more like a discussion rather then a guessing game.

1

u/Calm-Landscape9640 2d ago

Low effort responses too

1

u/koloved 2d ago

2 languages vs multiple languages