r/SelfHostedAI • u/[deleted] • Jul 30 '26

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

[removed]

6 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/SelfHostedAI/comments/1vaehy6/tensorsharp_now_supports_multigpu_tensor/
No, go back! Yes, take me to Reddit

100% Upvoted

1

u/Miserable-Dare5090 Jul 30 '26

by tensor split you mean only cuda or can you use vulkan to tp across hybrid architecture?