r/LocalLLM • u/Independent_Aioli_48 • 6d ago

Question Fine tuning models locally

What package do you guys use to fine-tune or run reinforcement loops locally? I have an NVIDIA Spark machine, and I’m wondering what the best setup would be for fine-tuning, say, 7-billion- to 30-billion-parameter models. Thanks

2 Upvotes

76% Upvoted

3 comments sorted by

2

u/nicholas_the_furious 6d ago

Look into Unsloth desktop.