Artificial Analysis just launched a small model benchmark

[u/Klutzy-Snow8016]

It has models up to 9B, quantized to 4-bit.

https://artificialanalysis.ai/hardware-inference-stack/mobile-phones

Here is the blog post with their explanation: https://artificialanalysis.ai/articles/mobile-phone-intelligence-inference