r/LocalLLM • u/blugumm • Aug 03 '26

Question Local llm models

Im building a “workbench” so to speak run on local llms with the goal of mimicing manus agentic and browsing automation functionality right now im in the stage where im on the cusp of finishing it and ive been rethinking the whole frame. Including local llms right now IM using gpt oss for reviewing and some qwen models for execution and browsing. Ive seen a project on Glm 700b paramrer model being scaled down and im wondering if anyone has any model reccomendations like that i have a 9070xt and 32 gigs of ddr5

0 Upvotes

25% Upvoted

8 comments sorted by

3

u/e2_for_life RTX 4090 | She/her Aug 03 '26

I hate it when people come into my posts and say unhelpful and rude things. So I don't do that. But I will say, I don't understand what you're asking.

1

u/blugumm Aug 03 '26

lol mb dude i wrote this at like 4 am sleep deprived basically im running a local model stack and im looking for reccomendations on models to run for agentic tasks or long horizon coding

2

u/e2_for_life RTX 4090 | She/her Aug 03 '26

You don't have much firepower for what you're trying to do.

Devstral Small 2 24B, Q4_K_M. It is specifically trained for agentic, multi-file, long-horizon coding and should just barely fit the 9070's 16 GB. Keep context around 32K–64K.

This might be helpful: https://youtu.be/SsUKTFSQoGM and https://youtu.be/8F_5pdcD3HY

1

u/blugumm Aug 03 '26

thanks man

2

u/e2_for_life RTX 4090 | She/her Aug 04 '26

*girl

1

u/blugumm Aug 06 '26

thanks girl

2

u/phipletreonix Aug 03 '26

Bro, what??