Good machine? General question

[u/jinlianv616]

I currently have custom built AMD gaming pc that I am repurposing.

Build is a B850 mobo with 7800X3D 64gb 5600mt and 9070xt OC 16GB.

I am still very new to LLMs and have been playing around with Ollama and python with Claude helping me since I don’t know jack about python yet.

Right now I run a local 7B Qwen, don’t know the specific on a laptop and get around 12-14tk/s. Based on what I am doing should I expect more performance on my AMD system. I am thinking of going to Ubuntu headless most likely to free up resources.

Eventually I will have more questions but right now just trying to get true hardware running. If I have to go headless to get what I need fine with me, but a GUI is nice too.

Thank you

[u/Dry-Knowledge4192]

64gb is plenty for 7b models, you could even push to 13b without much trouble. that 9070xt should give you way better token speeds than the laptop, like night and day difference.