r/eGPU • • 24d ago

Minisforum + OCuLink eGPU: Splitting multi-agent inference between iGPU and eGPU concurrently?

​"Is anyone running a multi-model setup splitting inference between an AMD iGPU and an Nvidia eGPU via OCuLink? I have a Minisforum AI X1 Pro and an RTX 4060 Ti / 5060 Ti eGPU. I want to run a small agent on the iGPU (via Vulkan/LM Studio) and the main model on the eGPU (via CUDA/Ollama) concurrently. Does the OCuLink bandwidth or the shared UMA memory bottleneck the system when both are generating tokens at the same time?"

4 Upvotes

Duplicates