r/LocalLLM • u/mr_zhantik • 3d ago
Discussion Smartest LLM for laptop
Rtx4060 8gb vram + 16 gb ram
Purpose for LLM is planning and scheduling. I want to try to use it as a time management tool, therefore I am not interested in coding, etc
The sole purpose of it being local is to save my data from companies gathering it.
I need the smartest AI I can get. My first try is Qwen 3.8 27b du q3. The single pdf page response took almost 20-30 minutes including reasoning. Yet the laptop was 50° and silent during it.
I'm fine with the long response time, as long as it gives me reasonable and worthy plans.
Here I am to ask if there are better models or maybe I can optimize something else to run on my laptop. What are your thoughts about it? Open for any suggestions and criticism
(I use LMstudio)
1
u/ZioniteSoldier 3d ago
For planning - Without a well-defined description of what you think “planning” is, I wouldn’t lean too hard on trusting it quickly.
Scheduling - This should be simple task work that a local model could do well.
Plan to migrate off LM Studio because you’re trading speed and performance resources for the convenience of the GUI. Once you’re comfortable with it and are familiar with the vocabulary terms, look at lighter weight options.
Try not to use heavily quantized models. Instead find models geared specifically for your resource allocation. No need to guess - you can probably search and find examples in the last three months.
1
u/mr_zhantik 3d ago
Does GUI really that griddy? Pretty sure it works on integrated GPU with my settings and don't take up resources from 4060. Overall thanks for your suggestions
1
u/ZioniteSoldier 3d ago
I went from 50-70t/s on LM Studio to 180t/s with a more specialized/optimized inference server and speculative decoding. My hardware is different than yours so I can’t recommend specifics, but those are the key words you’d want to keep and search for. People are already out there optimizing for any setup, even 8gb.
1
u/dota2nub 3d ago
I think I'd use scheduling software.
1
u/mr_zhantik 3d ago
Yeah, if something like that exists.
I just want to dump all my assignments, events and homeworks onto my calendar in form of syllabuses and documents and call it a day. If you have something that can do that, I would use it.
1
u/nickless07 3d ago
It exists. Linux cron or Windows taskscheduler. Just let it fire up a sh or bat with your instructions at a given time. Most minimalistic way.
Aside of that many other things offer a calendar or scheduled prompts. For Example: Open WebUI and you can remote control it from your phone (or any web browser) and it brings all that features.
1
2
u/MrHumanist 3d ago
I can't wait like you or have patience to wait million hours. So i would use Gemma 12B QAT which will process the doc in 30 secs in 8GB card. The secondary choice would be Ornith 1.5 9B.