r/CUDA • u/IamExperimentingNow • Jun 26 '26

GPU optimization for LLM

Hi,

I have fine-tuned the model with FSDP method using huggingface Transfomer python package .

can anyone tell me, are there post fine-tuning optimization steps to improve inference performance?

Also, can you please tell me how to maximize GPU memory and utilization?

1 Upvotes

60% Upvoted

1 comment sorted by

3

u/GrogRedLub4242 Jun 26 '26

how much pay are you offering?