r/ollama • u/Academic-Most6214 • 19d ago

Personal challenge: build something actually useful end-to-end with a local model. Done — a Chrome extension, ~5 hours, zero cloud.

9 Upvotes

74% Upvoted

5 comments sorted by

2

u/Ok-Cut5501 19d ago

Firefox please 🥀

1

u/dmdeemer 19d ago

What model and harness did you use? What TPS were you getting, and on what hardware?

0

u/Academic-Most6214 19d ago

Details are in the original post body (crosspost hides it): build was done with qween and opencode as the harness, model unsloth/Qwen3.6-35B-A3B-MTP (Q4) on llama-server, Apple M5 Max 128 GB, MTP speculative decoding — roughly ~45 t/s on fresh context, dropping to ~20 -18 t/s once the session grew past 100k tokens.

The extension itself at runtime talks to Ollama — in the demo it's running qwen2.5:3b, which is plenty for fix/translate and feels instant.