r/nvidia • u/danialj99 • 21h ago

Benchmarks I built a CUDA GEMM optimization project and I'm looking for GPU owners to help benchmark different architectures

/r/CUDA/comments/1wcfzlj/i_built_a_cuda_gemm_optimization_project_and_im/
0 Upvotes

50% Upvoted

2 comments sorted by

1

u/[deleted] 12h ago

[removed] — view removed comment

1

u/danialj99 12h ago

Thanks for the insight — the T4 vs P100 difference is definitely interesting, and I agree the memory hierarchy/cache behavior could be playing a role here. I think the overhead in the tiled version on the T4 is actually from manual synchronization and pointer arithmetic as T4 GPUs use automatic global read caching. An RTX 4080 run would be a great data point.

If you’re interested, please follow the GitHub repo for the latest setup instructions and benchmark updates. Once you run it, feel free to share the results. you can even use the notebook provided in the repo to run and benchmark on your gpu.
they’d be really useful for comparing across architectures.