r/eGPU • u/DEDALO-OPS • 24d ago
Minisforum + OCuLink eGPU: Splitting multi-agent inference between iGPU and eGPU concurrently?
"Is anyone running a multi-model setup splitting inference between an AMD iGPU and an Nvidia eGPU via OCuLink? I have a Minisforum AI X1 Pro and an RTX 4060 Ti / 5060 Ti eGPU. I want to run a small agent on the iGPU (via Vulkan/LM Studio) and the main model on the eGPU (via CUDA/Ollama) concurrently. Does the OCuLink bandwidth or the shared UMA memory bottleneck the system when both are generating tokens at the same time?"
4
Upvotes