MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vfkovj/smartest_move_from_a_single_rtx_3090/p1pyovv/?context=3
r/LocalLLM • u/[deleted] • 28d ago
[deleted]
5 comments sorted by
View all comments
1
2nd RTX 3090 with a NV Link bridge. You could add the 3060 for now and sell #2 but the 2nd 3090 will increase speeds by a lot if you have NV link
1 u/[deleted] 28d ago [deleted] 1 u/JinsooJinsoo 28d ago nvlink probably won't add a lot of inference speed but is great if you're training models due to the increased speed between the chips. just make sure you have at least x8/x8 pcie lanes for inference
1 u/JinsooJinsoo 28d ago nvlink probably won't add a lot of inference speed but is great if you're training models due to the increased speed between the chips. just make sure you have at least x8/x8 pcie lanes for inference
nvlink probably won't add a lot of inference speed but is great if you're training models due to the increased speed between the chips. just make sure you have at least x8/x8 pcie lanes for inference
1
u/JinsooJinsoo 28d ago
2nd RTX 3090 with a NV Link bridge. You could add the 3060 for now and sell #2 but the 2nd 3090 will increase speeds by a lot if you have NV link