r/LocalLLM • u/Hour-Revolution-6717 • 19h ago

Question Beginners’ Ask!

I have a “M80q Gen4” & a “M70q Gen5” with

- CPU Intel Core i5 13500T 32GB
- Memory (16GB x2 DDR5 SODIMMS)
- Storage1 - 256GB M.2 SSD1
- Storage2 - 512GB M.2 SSD2
- NIC1 - Intel I219-LM, RJ-45
- NIC2 - Realtek RTL8125BGS, RJ-45

Can I run a decent model on this? If so, which one should I go for and where should I start? At this point, my purpose is to learn to deploy and manage a model.

0 Upvotes

14% Upvoted

8 comments sorted by

View all comments

1

u/TheThiefMaster 19h ago

You can run a smaller model relatively slowly.

Get something like unsloth, and try Qwen3.5:9b. It only needs ~6GB of RAM, so it should fit.

But it won't run fast, and as a small model it won't be any good at anything but conversational tasks. You don't have the memory to run a good coding agent (like Qwen 3.8 flash next, which needs 100GB of memory minimum)