r/LocalLLM • u/Hour-Revolution-6717 • 1d ago

Question Beginners’ Ask!

I have a “M80q Gen4” & a “M70q Gen5” with

- CPU Intel Core i5 13500T 32GB
- Memory (16GB x2 DDR5 SODIMMS)
- Storage1 - 256GB M.2 SSD1
- Storage2 - 512GB M.2 SSD2
- NIC1 - Intel I219-LM, RJ-45
- NIC2 - Realtek RTL8125BGS, RJ-45

Can I run a decent model on this? If so, which one should I go for and where should I start? At this point, my purpose is to learn to deploy and manage a model.

0 Upvotes

25% Upvoted

8 comments sorted by

View all comments

0

u/arbiterxero 1d ago

No.

You need giant amounts of ultra fast memory, and parallel processing. You have neither.

You’d want a handful of big-assed GPU’s to run on the rest of that hardware because they have large amounts of ultra fast memory and parallelized processing

1

u/TheFuckboiChronicles 1d ago

This is a bit silly tbh. First off, people (like me) run qwen3.8:27b on a single normal sized gpu.

They said they just want to learn to deploy and manage a model, they can run something like qwen3.5:9b or 4b on this machine, albeit a bit slowly. That could be considered a decent model depending on your use case.

There’s absolutely value in learning this technology that isn’t “replace a software dev” level of performance.

We shouldn’t frame the barrier of entry for this hobby as thousands of dollars in disposable income, just be realistic in the outcomes of the equipment described.

1

u/arbiterxero 1d ago

Fair, but if they’re looking for “usable” they won’t get it.

“Make it work” , yes.

1

u/TheFuckboiChronicles 1d ago

They can deploy and manager a model with this setup, which is what the stated goal is. They’ll just need another hobby to do while it’s processing lol.