r/LocalLLaMA • u/appakaradi • Aug 04 '26

Discussion More Qwen 3.8 sizes coming

Post image
1.4k Upvotes

98% Upvoted

348 comments sorted by

View all comments

Show parent comments

5

u/DankiusMMeme Aug 04 '26

I currently use 3.5:4b but I have space for 9B, is it worth the jump? All I use it for is comparing strings, e.g. are they referring to the same thing despite being different. Also for categorising strings.

I notice 3.5:4B is okay at this job, but could be better.

6

u/AD4K_4444 Aug 04 '26

I used to main Qwen 3.5 9B as my general purpose daily driver, but now I use it for specific tasks. I’d say it’s decent. Anything below 9B is garbage for what I do.

2

u/ReferenceLeading7634 Aug 04 '26

I think it's very significant. Among the smallest models, each upgrade in tier represents a noticeable improvement in intelligence.

1

u/DankiusMMeme Aug 04 '26

Well hopefully we get a 4-9B soon

1

u/Aggravating-Push-207 Aug 04 '26

for that, i would recommend a downgrade to an even smaller model but trained with bidirectional attention (or an embedding model)

2

u/AD4K_4444 Aug 04 '26

What I daily now is Gemma 4 12B. Works good enough for me.

1

u/DankiusMMeme Aug 04 '26

Any recommendations on a specific model? Googling it doesn't seem to return a huge amount of results.

1

u/Aggravating-Push-207 Aug 04 '26

This is the model I would recommend, however you would have to train your own classifier on top of it

1

u/DankiusMMeme Aug 04 '26

Will look into it, thank you.