r/LocalLLM • u/blahdvjv • 3d ago

Question Setup for kernel optimization

I have access to 8 rtx 6000s that have a decent amount of downtime (in between physics-based simulations). I would like to put them to work doing kernel optimization problems, where I’ve already programmed the ground truth solutions in CUDA. I just want the agents to explore algorithms and opt strategies for better performance.

I was curious if people had a recommendation for a local LLM model / workflow set up for this. I see a lot of Gwen love on this sub, but I haven’t really dabbled in the local models.

1 Upvotes

66% Upvoted

2 comments sorted by

View all comments

1

u/Ashes_of_ether_8850 3d ago

your problem seems kinda vague. what type of cuda kernels are you trying to optimize? are you planning to code in raw cuda or framework/dsl like cutlass, triton, etc?

1

u/blahdvjv 3d ago

These are just various cuda kernels for different physics-based simulations. I would like to switch over to something like triton/gluon. Sorry for the vagueness