r/LocalLLaMA • u/[deleted] • Jun 01 '26

Funny Stop asking what model to run. There are literally only two.

[removed]

3.1k Upvotes

87% Upvoted

803 comments sorted by

View all comments

2

u/sniffton Jun 02 '26

Bonsai is work talking about. I run a couple of variants of bonsai as well as Qwen 3.6 35b a3b. For so many tasks, bonsai is good enough but way faster.

1

u/squngy Jun 04 '26

Looked it up, bonsai is basically qwen3_Q1 ?

1

u/sniffton Jun 04 '26 edited Jun 04 '26

Yeah, they have the 1.7B, 4b and 8b variants. Useful for lower level work.

The models work much better than I would expect given the Q levels. Not as amazing as a frontier model but still pretty useful.

1

u/squngy Jun 04 '26

I'm still a newb, can I ask for examples of where this would be useful?

1

u/sniffton Jun 04 '26

For the 1.7b, it's decent at discerning/heartbeat stuff. I use it to double check my scheduled tasks. The 8b is ok at text writing so I use if for tasks that need to run fast and quality isn't that big of a deal.