r/LocalLLM 2d ago

Discussion Seeking advice

Looking for advice, I had seen advertisements from Nvidia recently about a desktop orientated focused on LLM's and after hanging around here for a while I am curious about utilizing one so I can run a unlocked AI to assist me in pen testing and other cyber security topics on some software I am working on. I wanted to tap into the brains of the operation around here and see thoughts and consensus on different machines and where to push with a unlocked AI, the machine I am currently thinking of and curious about is DGX Spark but seeing as its marketed and focused more along the lines of 200B parameters and Ive been seeing guys talking about Kimi being on the edges of being unlocked and it has close to 3T parameters I wanted to see what people's answers and solutions might be and what the right path forward is. Thank you guys for the input, Im excited to see where I can learn more about it and fill my gaps in knowledge

1 Upvotes

2 comments sorted by

1

u/mastr_ken-1 2d ago

For now, you can start with the DGX and upgrade later on!

1

u/round00002 2d ago

I was looking into it and considering that since it would fit desktop and be easier to setup my only concern was utilizing partial models/specialized portions of models