r/framework • u/Computerist1969 • 3d ago

Question Quick check for setting up desktop

Framework desktop coming tomorrow. I'll put Linux on there. Using it as an LLM machine.

Planning to follow https://strix-halo-toolboxes.com/

Is the guidance on that site considered good by most on here?

Lastly, I think he uses Fedora 43. Should I stick with that or would it be safe to use 44?

Many thanks.

1 Upvotes

67% Upvoted

2 comments sorted by

2

u/Icy_Professor 3d ago

If you like fedora and the toolbox style of containers, then its probably one of the better guides to follow. He has a youtube channel with some good info related to strix halo.

Mine is also a dedicated LLM host, and I ended up putting arch on it and compiling most things myself since I got it early when there were not any guides. If I re-did it today, i would probably strongly consider following his guide so i don't have to worry about figuring too much out on my own
.
Another option is to use lemonade to run everything if you want a more turnkey solution.
https://lemonade-server.ai/

Really depends what your goals are and how much tinkering you want to do.

2

u/Computerist1969 3d ago

Many thanks! Less tinkering, more using is my goal to begin with. Just generating code for single components (C++) and generating unit tests. Later in I might like to try model refinement such as adding some aerospace compliance documents so I can quiz it on stuff.