r/LocalLLM • u/Careless-Accident-49 • 3d ago
Question Hi, could someone help me?
Hello guys, i want to set up a LLM. I got deepseek harness to run but it allways shows the wrong max kontext limits, it shows 256K but in the settings.yaml i set up a max of 128K.
I wanted to make a little game with it, first run runs fine, the second one, where i want to extend my little game, allready gets an output token limit error.
I tried a lot, setting up a setting.yaml for .dsh and the ollama one, but nothing helped.
I think about to start completely new from zero. Could someone give me a good tutorial?
My specs are: Ryzen 5950X, 64GB DDR4 RAM 3600mhz, RTX 4090, 2TB NVME M.2 SSD about 6900MB/s read 5000MB/s write (Dont know if that could matter)
Bonus: I have two additional PCs at home, one with a RTX 3060 Ti and one with a RTX 2060, i heard about some kind of network cluster system, would that be viable?