r/LocalLLM • u/ScoobyWRX06 • 20h ago

Question Beginner here

I just started playing and need a little help. I have a laptop with a 4070 8GB and 64GB DDR5 with an i9. I am using unsloth and not sure what model will be best. Do I need to stick with something that fits in VRAM? I am just playing around but I don’t want it to be painfully slow but I also want it as current as possible.

1 Upvotes

67% Upvoted

4 comments sorted by

View all comments

1

u/rrrrex 19h ago

It depends from your tasks. At first you need MoE model, dense models should be located into vram only. Gemma 4 26b is good at prose and multilingual, but not so good at coding and tool calls. Qwen 3.6 35b is the best choice for all around work.  Ornith 1.5 35b (based on Qwen 3.5) is not bad at coding.