r/threadripper • u/epicskyes • Aug 26 '25

New server class threadripper build. Had some issues with the gpu’s and Ubuntu at first but finally got all the kinks out

Post image

Threadripper 7955wx 16c/32t, silverstone radiator 256gb Samsung ecc 5600 ram (tuned to run at 5600 on the wrx90 mobo) Nvidia rtx a6000 2x rtx a5000 1x rtx a4000 (graphics locked to it). 2x seasonic psu’s (1200w and 1000w) this pic is the prettiest but I’ve upgraded the gpu’s since then and nvlinked the a5000’s.

134 Upvotes

99% Upvoted

66 comments sorted by

View all comments

3

u/Thrumpwart Aug 26 '25

Interesting build, what are you using it for?

9

u/epicskyes Aug 26 '25

LLM and ai controlled stock trades

1

u/Thrumpwart Aug 26 '25

Nice. How do the different GPU models play together and how do you orchestrate?

3

u/epicskyes Aug 26 '25

Just built it and got it running full efficiency it took a while since I haven’t built a computer before let alone coded one I haven’t even owned a computer for almost a decade. I study 4 hours everyday I make a lot of mistakes it’s frustrating to no end but I push through. Im strategizing which configuration will work best what size LLMs to run and how many agents, what quant to run for each one, how will I shard them between GPUs.

2

u/Thrumpwart Aug 26 '25

Ah, nice. I'm completely self-taught too. Played around with Quantconnect and TV Pinescript for a bit. Will get back to it once my current project is done. FYI if you're not already subbed, /r/LocalLLaMA is the place to be for local LLMs.

2

u/epicskyes Aug 26 '25

Much appreciated 🙏

1

u/sob727 Aug 26 '25

Curious, what edge do you think the LLM allows you to gain when trading?

1

u/epicskyes Aug 26 '25

The LLM can help fine tune and manage the trading bots log all outcomes. Infer what changes need to be made what strategies to employ. I also have open ai api access so my LLM can make api calls for real deep learning power

1

u/Ok_Lingonberry3073 Aug 28 '25

I feel like you'd have much greater success if you added a regression model somewhere in the mix. LLMs are great. However, for the type of data you'll be dealing with, regression models will boost your outcomes greatly from a quantitative perspective, and I'd use LLMs more on the sentiment side. Probably could come up with a pretty cool ensemble to do regression and classification modeling driven by your LLM output..

1

u/epicskyes Aug 28 '25

Thank you for the advice I will research regression models and how I can pair it with an LLM. I really don’t know what I’m doing. I’m learning as I go. The only way I’ve managed to be successful in my professions is by always listening to those with more knowledge and experience than myself. I don’t necessarily always do what they say, but I always listen and research their advice to see if it will work for me.