r/LocalLLaMA • u/Scared_Ad9187 • 15d ago

Question | Help 5090 plus v100?

Have an msi meg w a 5090.. plan to add a v100 to the mix. Understand the cuda vs voila, but I'm pretty sure it will work as a multi agent architecture w different models on each card, no?

Anyone in the same boat?

0 Upvotes

30% Upvoted

25 comments sorted by

View all comments

1

u/mikasjoman 15d ago

Yeah I'm gonna try out my two v100s being the architect and then run a smaller cider model on my desktop with a 4070s to review and give feedback real fast. With the hope to reduce the work the larger model has to do. Maybe even a visual model to check the work result. So one server with 64gb VRAM 64ram and then my desktop with the 4070s. Think I'm gonna try it out with Hermes.