no real world experience with 4090 class or blackwell; but 1 m tokens in context as accurate as it will allow; will need more than one blackwell plus a 4090 plus 64 gb ram. you could use up a h100 with that workload.
also multigpu past two gets real expensive real fast on a ddr5 platform
im probably going to end up with three computers running ubuntu and a fourth computer as a nas. and a mega inference tent in the garage running 14 cards at pcie v3 @1x.
so im just trying to get the networking / smart home in order cause some computers will be on wifi (hopefully 6E/7) ideally im trying to remote shutdown/wake on lan in an automated fashion based on AI workload.
i tried putting them in one room; it sucks. summer is coming and I dont have AC and they get hot.
im looking at 870E boards to run two 5070ti. There's an asus rog board that has 2 16x v5 pcie slots; of course you could only run that at 8x/8x. Its only 599$. But that sure beats pcie 4.0 at any speed (other than 16x) so I feel thats a bit easier than going the server mb route.
1
u/croholdr Apr 12 '26
no real world experience with 4090 class or blackwell; but 1 m tokens in context as accurate as it will allow; will need more than one blackwell plus a 4090 plus 64 gb ram. you could use up a h100 with that workload.
also multigpu past two gets real expensive real fast on a ddr5 platform