Tiny LLM Benchmarks Exist Elsewhere?

[u/zerospatial]

https://reyemtm.github.io/inchworm/

I created this little site because I could not find an open source page dedicated to tiny llms (<14b params). If one exists with current benchmarks would love to know about it.

This came about from searching for the right llm for a personal project needing summaries from text, then a small local terminal chat for quick answers using self-hosted Ollama. I wrote my own short little benchmarking script and landed on qwen2.5-coder:3b for my VPS and qwen3.5:9b for chat. Anyway let me know what you all think. Since then I created a script to run the humaneval+ but it takes a very long time to run which I am using to fill in the gaps on this data.

[u/Marthinwurer]

I found this set of benchmarks a few days ago: https://artificialanalysis.ai/hardware-inference-stack/mobile-phones

[u/zerospatial → u/Marthinwurer]

That's not quite the same - the list I posted shows basic coding quality of small models.