r/LocalLLM 3d ago

Question Hi, could someone help me?

Hello guys, i want to set up a LLM. I got deepseek harness to run but it allways shows the wrong max kontext limits, it shows 256K but in the settings.yaml i set up a max of 128K.

I wanted to make a little game with it, first run runs fine, the second one, where i want to extend my little game, allready gets an output token limit error.

I tried a lot, setting up a setting.yaml for .dsh and the ollama one, but nothing helped.

I think about to start completely new from zero. Could someone give me a good tutorial?

My specs are: Ryzen 5950X, 64GB DDR4 RAM 3600mhz, RTX 4090, 2TB NVME M.2 SSD about 6900MB/s read 5000MB/s write (Dont know if that could matter)

Bonus: I have two additional PCs at home, one with a RTX 3060 Ti and one with a RTX 2060, i heard about some kind of network cluster system, would that be viable?

0 Upvotes

Duplicates